This paper compares some of the common tools and techniques that enable state-of-the-art systems to provide high-level control of mobile sensor networks. There is currently a great deal of interest in employing unmanned and autonomous vehicles in intelligence, surveillance, and reconnaissance operations. Although this paper addresses issues common to all mobile sensor networks, the applications presented are typically associated with autonomous vehicles. We focus specifically on three high-level areas: 1. mission definition languages that allow human users to compose missions defined in terms of tasks, 2. communication-addressing degradation and loss and relationship to underlying system architecture design, and 3. task allocation among the assets.

Issue Section:
Technology Reviews
Keywords:
control engineering computing, distributed control, mobile computing, mobile radio, mobile robots, remotely operated vehicles, surveillance, wireless sensor networks
Topics:
Computer software, Sensor networks, Vehicles, Surveillance
1.
Zhang
,
H.
,
Olariu
,
S.
,
Cao
,
J.
, and
Johnson
,
D. B.
, eds., 2007, “
Mobile Ad-Hoc and Sensor Networks
,”
Proceedings of the Third International MSN Conference
(
Lecture Notes in Computer Science
),
Springer
,
Berlin
, Vol.
4864
/2007.
2.
Shorey
,
R.
,
Ananda
,
A.
,
Chan
,
M. C.
, and
Ooi
,
W. T.
, eds., 2006,
Mobile, Wireless, and Sensor Networks—Technology, Applications, and Future Directions
,
Wiley
,
Hoboken, NJ
.
3.
Wang
,
G.
,
Cao
,
G.
,
La Porta
,
T.
, and
Zhang
,
W.
, 2005, “
Sensor Relocation in Mobile Sensor Networks
,”
Proceedings of the 2005 IEEE INFOCOM
, Miami, FL.
4.
Chong
,
C. -Y.
, and
Kumar
,
S. P.
, 2003, “
Sensor Networks: Evolution, Opportunities, and Challenges
,”
Proc. IEEE
0018-9219,
91
(
8
), pp.
1247
–
1256
.
Crossref
Search ADS
 
5.
Howard
,
C. E.
, 2008, Smart Sensors: Homeland Security and Military Personnel Increasingly Rely on Intelligent Sensor Technology for Surveillance and Electronic Intelligence, Military and Aerospace Electronics Magazine.
6.
Moline
,
M. A.
,
Blackwell
,
S. M.
,
von Alt
,
C.
,
Allen
,
B.
,
Austin
,
T.
,
Case
,
J.
,
Forrester
,
N.
,
Goldsborough
,
R.
,
Purcell
,
M.
, and
Stokey
,
R.
, 2005, “
Remote Environmental Monitoring Units: An Autonomous Vehicle for Characterizing Coastal Environments
,”
J. Atmos. Ocean. Technol.
0739-0572,
22
, pp.
1797
–
1808
.
Crossref
Search ADS
 
7.
Steinberg
,
M.
, 2006, “
Intelligent Autonomy for Unmanned Naval Vehicles
,”
Proceedings of 2006 SPIE Unmanned Systems Technology Conference
.
8.
Sycara
,
K. P.
, 1998, “
Multiagent Systems
,”
AI Mag.
0738-4602,
19
(
2
), pp.
79
–
92
.
9.
Bond
,
A. H.
, and
Gasser
,
L. G.
, 1988,
Readings in Distributed Artificial Intelligence
,
M. Kaufmann
,
San Mateo, CA
.
10.
Girard
,
A. R.
Klesh
,
A. T.
, and
Lavis
,
B. M.
, 2009, “
Vehicle-Level Control of Mobile Sensor Networks: A State of the Art Review
,”
ASME J. Dyn. Syst., Meas., Control
0022-0434, to be published.
11.
MacKenzie
,
D. C.
,
Cameron
,
J. M.
, and
Arkin
,
R. C.
, 1995, “
Specification and Execution of Multiagent Missions
,”
Proceedings of 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems 95. ‘Human Robot Interaction and Cooperative Robots’
, Vol.
3
, pp.
51
–
58
.
12.
MacKenzie
,
D. C.
,
Arkin
,
R.
, and
Cameron
,
J. M.
, 1997, “
Multiagent Mission Specification and Execution
,”
Auton. Rob.
0929-5593,
4
(
1
), pp.
29
–
52
.
Crossref
Search ADS
 
13.
Hsieh
,
M.
,
Chaimowicz
,
L.
,
Cowley
,
A.
,
Grocholsky
,
B.
,
Keller
,
J.
,
Kumar
,
V.
,
Taylor
,
C.
,
Endo
,
Y.
,
Arkin
,
R.
,
Jung
,
B.
,
Wolf
,
D.
,
Sukhatme
,
D.
, and
MacKenzie
,
G.
, 2007, “
Adaptive Teams of Autonomous Aerial and Ground Robots for Situational Awareness
,”
Journal of Field Robotics
,
24
(
11–12
), pp.
991
–
1014
.
14.
Duarte
,
C. N.
, and
Werger
,
B. B.
, 2000, “
Defining a Common Control Language for Multiple Autonomous Vehicle Operation
,”
Proceedings of the MTS/IEEE OCEANS Conference and Exhibition
, Vol.
3
, pp.
1861
–
1867
.
15.
Duarte
,
C. N.
,
Martel
,
G. R.
,
Eberbach
,
E.
, and
Buzzell
,
C.
, 2004, “
Talk Amongst Yourselves: Getting Multiple Autonomous Vehicles to Cooperate
,”
Proceedings of IEEE/OES Autonomous Underwater Vehicles
, pp.
96
–
101
.
16.
Nishiyama
,
H.
,
Ohwasa
,
H.
, and
Mizoguchi
,
F.
, 1998, “
A Multiagent Robot Language for Communication and Concurrency Control
,”
Proceedings of the International Conference on Multi Agent Systems
, pp.
206
–
213
.
17.
Love
,
J.
,
Jariyasunant
,
J.
,
Pereiera
,
E.
,
Zennaro
,
M.
,
Hedrick
,
K.
,
Kirsch
,
C.
, and
Sengupta
,
R.
, 2009, “
CSL: A Language to Specify and Re-Specify Mobile Sensor Network Behaviors
,”
IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS)
.
18.
Jin
,
Y.
,
Minai
,
A.
, and
Polycarpou
,
M.
, 2003, “
Cooperative Real-Time Search and Task Allocation in UAV Teams
,”
Proceedings of the 42nd IEEE Conference on Decision and Control
, Vol.
1
, pp.
7
–
12
.
19.
McGee
,
T. G.
, and
Hedrick
,
J. K.
, 2006, “
Guaranteed Strategies to Search for Mobile Evaders in the Plane
,”
Proceedings of 2006 American Controls Conference
, Minneapolis, MN, pp.
2819
–
2824
.
20.
Ulam
,
P.
,
Endo
,
Y.
,
Wagner
,
A.
, and
Arkin
,
R.
, 2007, “
Integrated Mission Specification and Task Allocation for Robot Teams—Design and Implementation
,”
Proceedings of IEEE International Conference on Robotics and Automation
, pp.
4428
–
4435
.
21.
Wagner
,
A. R.
,
Endo
,
Y.
,
Ulam
,
P.
, and
Arkin
,
R. C.
, 2006, “
Multirobot User Interface Modeling
,”
Distributed Autonomous Robotic Systems
,
Springer
,
New York
, Vol.
7
, pp.
237
–
248
.
22.
Mupparapu
,
S.
,
Chappell
,
S.
,
Komerska
,
R.
,
Blidberg
,
D.
,
Nitzel
,
R.
,
Benton
,
C.
,
Popa
,
D.
, and
Sanderson
,
A.
, 2004, “
Autonomous Systems Monitoring and Control (ASMAC)—An AUV Fleet Controller
,”
Autonomous Underwater Vehicles
, in Proceedings IEEE/OES Autonomous Underwater Vehicles Workshop, AUV-04, Sebasco Estates, Main, pp.
119
–
126
.
23.
Tisdale
,
J.
,
Ryan
,
A.
,
Zennaro
,
M.
,
Xiao
,
X.
,
Caveney
,
D.
,
Rathinam
,
S.
,
Hedrick
,
J. K.
, and
Sengupta
,
R.
, 2006, “
The Software Architecture of the Berkeley UAV Platform
,”
Computer Aided Control System Design, IEEE International Conference on Control Applications, IEEE International Symposium on Intelligent Control
, pp.
1420
–
1425
.
24.
Baranov
,
S.
, 1997, “
Synthesis of Control Units for Mobile Robots
,”
Second EUROMICRO Workshop on Advanced Mobile Robots
, pp.
80
–
86
.
25.
Schiller
,
I.
, and
Draper
,
J.
, 1991, “
Mission Adaptable Autonomous Vehicles
,”
IEEE Conference on Neural Networks for Ocean Engineering
, pp.
143
–
150
.
26.
Davis
,
D. T.
, 2005, “
Automated Parsing and Conversion of Vehicle-Specific Data Into Autonomous Vehicle Control Language (AVCL) Using Context-Free Grammars and XML Data Binding
,”
Proceedings of the 14th International Symposium on Unmanned Untethered Submersible Technology
, Durham, NH.
27.
Lundell
,
M.
,
Tang
,
J.
, and
Nygard
,
K.
, 2005, “
Fuzzy Petri Net for UAV Decision Making
,”
International Symposium on Collaborative Technologies and Systems
, pp.
347
–
352
.
28.
Gutiérrez
,
P.
,
Barrientos
,
A.
,
del Cerro
,
J.
, and
San Martín
,
R.
, 2006, “
Mission Planning and Simulation of Unmanned Aerial Vehicles With a GIS-Based Framework
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference and Exhibit
, Keystone, CO, Paper No. AIAA 2006-6198.
29.
Giger
,
G.
,
Kandemir
,
M.
,
Lovell
,
S. D.
,
Dzielski
,
J.
, and
Tangirala
,
S.
, 2007, “
Automated Mission Parallelization for Unmanned Underwater Vehicles
,”
AAAI Fall Symposium Regarding the Intelligence in Distributed Intelligent Systems
.
30.
Xu
,
L.
, and
Ozguner
,
U.
, 2003,
Battle Management for Unmanned Aerial Vehicles
,
Proceedings of the 42nd IEEE Conference on Decision and Control
, Vol.
4
, pp.
3585
–
3590
.
31.
Eberbach
,
E.
,
Duarte
,
C.
,
Buzzell
,
C.
, and
Martel
,
G.
, 2003, “
A Portable Language for Control of Multiple Autonomous Vehicles and Distributed Problem Solving
,”
Proceedings of the Second International Conference on Computational Intelligence, Robotics and Autonomous Systems CIRAS
, Singapore, Vol.
3
, pp.
15
–
18
.
32.
Kanayama
,
Y.
, and
Wu
,
C.
, 2000, “
It’s Time to Make Mobile Robots Programmable
,”
Proceedings of International Conference on Robotics and Automation (ICRA)
, Vol.
1
, pp.
329
–
334
.
33.
Kirsch
,
C. M.
,
Lopes
,
L.
, and
Marques
,
E. R. B.
, 2008, “
Semantics-Preserving and Incremental Runtime Patching of Real-Time Programs
,”
Proceedings of Workshop on Adaptive and Reconfigurable Embedded Systems (APRES)
.
34.
Baliga
,
G.
,
Graham
,
S.
,
Gunter
,
C.
, and
Kumar
,
P.
, 2006, “
Reducing Risk by Managing Software Related Failures in Networked Control Systems
,”
Proceedings of the 45th IEEE Conference on Decision and Control
, pp.
2866
–
2871
.
35.
Sinopoli
,
B.
,
Schenato
,
L.
,
Franceschetti
,
M.
,
Poolla
,
K.
,
Jordan
,
M. I.
, and
Sastry
,
S. S.
, 2004, “
Kalman Filtering With Intermittent Observations
,”
IEEE Trans. Autom. Control
0018-9286,
49
(
9
), pp.
1453
–
1464
.
Crossref
Search ADS
 
36.
Makarenko
,
A. A.
, 2004, “
A Decentralized Architecture for Active Sensor Networks
,” Ph.D. thesis, University of Sydney.
37.
Makarenko
,
A.
, and
Durrant-Whyte
,
H.
, 2004, “
Decentralized Data Fusion and Control in Active Sensor Networks
,”
Proceedings of the International Conference on Information Fusion
, Stockholm, Sweden.
38.
Utete
,
S.
, and
Durrant-Whyte
,
H.
, 1994,
Reliability in Decentralized Data Fusion Networks
,”
Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems
, pp.
215
–
221
.
39.
Pinto
,
M.
,
Bonivento
,
A.
,
Sangiovanni-Vincentelli
,
A.
,
Passerone
,
R.
, and
Sgroi
,
M.
, 2006, “
System Level Design Paradigms: Platform-Based Design and Communication Synthesis
,”
ACM Transactions on Design, Automation and Electronic Systems
,
11
(
3
), pp.
537
–
563
.
Crossref
Search ADS
 
40.
Szyperski
,
C.
, 2002,
Component Software: Beyond Object-Oriented Programming
, 2nd ed.,
Addison-Wesley
,
Boston, MA
.
41.
Kahn
,
J.
,
Katz
,
R.
, and
Pister
,
K.
, 2000, “
Emerging Challenges: Mobile Networking for ‘Smart Dust’
,”
Journal of Communication Networks
,
2
, pp.
188
–
196
.
Crossref
Search ADS
 
42.
Makarenko
,
A.
,
Brooks
,
A.
, and
Upcroft
,
B.
, 2007, “
An Autonomous Vehicle Using Ice and Orca
,” ZeroC’s Connections Newsletter Technical Report No. 22.
43.
Makarenko
,
A.
,
Brooks
,
A.
, and
Kaupp
,
T.
, 2007, “
On the Benefits of Making Robotic Software Frameworks Thin
,”
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Workshop on Evaluation of Middleware and Architectures
.
44.
ZeroC, Inc.
, Ice Manual. Online: http://zeroc.com/http://zeroc.com/
45.
Kaupp
,
T.
, 2009,
Human-Robot Collaboration—A Probabilistic Approach
,
VDM
,
Saarbrücken, Germany
.
46.
Kaupp
,
T.
,
Douillard
,
B.
,
Ramos
,
F.
,
Makarenko
,
A.
, and
Upcroft
,
B.
, 2007, “
Shared Environment Representation for a Human-Robot Team Performing Information Fusion
,”
J. Field Robot.
,
24
(
11–12
), pp.
911
–
942
.
47.
Microsoft
, 2008, Microsoft Robotics Developer Studio. http://msdn.microsoft.com/en-us/robotics/http://msdn.microsoft.com/en-us/robotics/
48.
JAUS Working Group
, 2006, “
JAUS History and Domain Model
,” SAE AS-4 Unmanned Systems Steering Committee Technical Report No. AIR5664. http://www.jauswg.org/http://www.jauswg.org/
49.
Brooks
,
A.
,
Kaupp
,
T.
,
Makarenko
,
A.
,
Orebäck
,
A.
, and
Williams
,
S.
, 2005, “
Towards Component-Based Robotics
,”
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems
, pp.
163
–
168
.
50.
Metta
,
G.
,
Fitzpatrick
,
P.
, and
Natale
,
L.
, 2006, “
YARP: Yet Another Robot Platform
,”
International Journal on Advanced Robotic Systems
,
3
(
1
), pp.
43
–
48
.
53.
Enright
,
K. S. J.
,
Frazzoli
,
E.
, and
Bullo
,
F.
, 2005, “
On Multiple UAV Routing With Stochastic Targets: Performance Bounds and Algorithms
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference and Exhibit
, Santa Barbara, CA, Paper No. AIAA-2005-5830.
54.
Sharma
,
V.
,
Savchenko
,
M.
,
Frazzoli
,
E.
, and
Voulgaris
,
P.
, 2005, “
Time Complexity of Sensor-Based Vehicle Routing
,”
Robotics: Science and Systems
, pp.
297
–
304
,
MIT
,
Cambridge, MA
.
55.
Chakravorty
,
S.
, and
Ramirez
,
J.
, 2007, “
Fuel Optimal Maneuvers for Multispacecraft Interferometric Imaging Systems
,”
J. Guid. Control Dyn.
0731-5090,
30
(
1
), pp.
227
–
236
.
Crossref
Search ADS
 
56.
Susca
,
S.
,
Martinez
,
S.
, and
Bullo
,
F.
, 2008, “
Monitoring Environmental Boundaries With a Robotic Sensor Network
,”
IEEE Trans. Control Syst. Technol.
1063-6536,
16
(
2
), pp.
288
–
296
.
Crossref
Search ADS
 
57.
Tisdale
,
J.
,
Kim
,
Z.
, and
Hedrick
,
J.
, 2009, “
Autonomous UAV Path Planning and Estimation
,”
IEEE Rob. Autom. Mag.
1070-9932,
16
(
2
), pp.
35
–
42
.
Crossref
Search ADS
 
58.
Pynadith
,
D. V.
, and
Tambe
,
M.
, 2002, “
The Communicative Multiagent Team Decision Problem: Analyzing Teamwork Theories and Models
,”
J. Artif. Intell. Res.
1076-9757,
16
, pp.
389
–
423
.
Crossref
Search ADS
 
59.
Rathinam
,
S.
, 2006, “
Routing and Monitoring Algorithms for UAVs
,” Ph.D. thesis, University of California, Berkeley.
60.
Gutin
,
G.
, and
Punnen
,
A. P.
, 2002,
The Traveling Salesman Problem and Its Variations
,
Kluwer Academic
,
Netherlands
.
61.
Papadimitriou
,
C.
, and
Steigliitz
,
K.
, 1998,
Combinatorial Optimization: Algorithms and Complexity
,
Dover
,
New York
.
62.
Christofides
,
N.
, 1976, “
Worst-Case Analysis of a New Heuristic for the Traveling Salesman Problem
,” School of Industrial Administration, Carnegie-Mellon University, Pittsburgh, PA, Technical Report No. 388.
63.
Bektas
,
T.
, 2006, “
The Multiple Traveling Salesman Problem: An Overview of Formulations and Solution Procedures
,”
Omega
0305-0483,
34
(
3
), pp.
209
–
219
.
Crossref
Search ADS
 
64.
Keviczky
,
T.
,
Borrelli
,
F.
, and
Balas
,
G. J.
, 2006, “
Decentralized Receding Horizon Control for Large Scale Dynamically Decoupled Systems
,”
Automatica
0005-1098,
42
(
12
), pp.
2105
–
2115
.
Crossref
Search ADS
 
65.
Alighanbari
,
M.
, and
How
,
J. P.
, 2008, “
A Robust Approach to the UAV Task Assignment Problem
,”
Int. J. Robust Nonlinear Control
1049-8923,
18
(
2
), pp.
118
–
134
.
Crossref
Search ADS
 
66.
Lagoudakis
,
M.
, 2005, “
Auction-Based Multi-Robot Routing
,”
Proceedings of Robotics: Science and Systems
, pp.
343
–
350
.
67.
Ryan
,
A.
,
Tisdale
,
J.
,
Godwin
,
M.
,
Coatta
,
D.
,
Nguyen
,
D.
,
Spry
,
S.
,
Sengupta
,
R.
, and
Hedrick
,
K.
, 2007, “
Decentralized Control of Unmanned Aerial Vehicle Collaborative Sensing Missions
,”
Proceedings of the American Control Conference
.
68.
Scrivener
,
S.
, and
Thompson
,
R.
, 1994, “
Survey of Time-Optimal Attitude Maneuvers
,”
J. Guid. Control Dyn.
0731-5090,
17
(
2
), pp.
225
–
233
.
Crossref
Search ADS
 
69.
Ryan
,
A.
,
Xiao
,
X.
,
Rathinam
,
S.
,
Tisdale
,
J.
,
Zennaro
,
M.
,
Caveney
,
D.
,
Sengupta
,
R.
, and
Hedrick
,
J. K.
, 2006, “
A Modular Software Infrastructure for Distributed Control of Collaborating UAVs
,”
Proceedings of the AIAA Conference on Guidance, Navigation, and Control
, Keystone, CO.
Copyright © 2011
 by American Society of Mechanical Engineers
You do not currently have access to this content.