Toward Robotic Sensor Webs: Algorithms, Systems, and Experiments

This paper presents recent advances in multiagent sensing and operation in dynamic environments. Technology trends point towards a fusion of wireless sensor networks with robotic swarms of mobile robots. In this paper, we discuss the coordination and collaboration between networked robotic systems, featuring algorithms for cooperative operations such as unmanned aerial vehicles (UAVs) swarming. We have developed cooperative actions of groups of agents such as probabilistic pursuit-evasion game for search and rescue operations, protection of resources, and security applications. We have demonstrated a hierarchical system architecture which provides wide-range sensing capabilities to unmanned vehicles through spatially deployed wireless sensor networks, highlighting the potential collaboration between wireless sensor networks and unmanned vehicles. This paper also includes a short review of our current research efforts in heterogeneous sensor networks, which is being evolved into mobile sensor networks with swarm mobility. In a very essential way, this represents the fusion of mobility of ensembles with the network embedded systems, the robotic sensor web.

[1]  Ronald S. Fearing,et al.  DASH: A dynamic 16g hexapedal robot , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Miklós Maróti,et al.  Radio interferometric geolocation , 2005, SenSys '05.

[3]  David E. Culler,et al.  Design of a wireless sensor network platform for detecting rare, random, and ephemeral events , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[4]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[5]  S. Shankar Sastry,et al.  Unmanned helicopter formation flight experiment for the study of mesh stability , 2007 .

[6]  Evan R. Ulrich,et al.  From falling to flying: the path to powered flight of a robotic samara nano air vehicle , 2010, Bioinspiration & biomimetics.

[7]  Gregory J. Pottie,et al.  Protocols for self-organization of a wireless sensor network , 2000, IEEE Wirel. Commun..

[8]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[9]  S. Shankar Sastry,et al.  Flying robots: modeling, control and decision making , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  David E. Culler,et al.  Trio: enabling sustainable and scalable outdoor wireless sensor network deployments , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[11]  Matt Welsh,et al.  MoteLab: a wireless sensor network testbed , 2005, IPSN '05.

[12]  Rahul Sukthankar,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[13]  Ronald S. Fearing,et al.  Analysis of off-axis performance of compliant mechanisms with applications to mobile millirobot design , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Xue Wang,et al.  Distributed Visual-Target-Surveillance System in Wireless Sensor Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Robert R. Bitmead,et al.  Performance and Computational Implementation of Nonlinear Model Predictive Control on a Submarine , 2000 .

[16]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  S. Shankar Sastry,et al.  Conflict resolution for air traffic management: a study in multiagent hybrid systems , 1998, IEEE Trans. Autom. Control..

[18]  Alborz Geramifard,et al.  On the Design and Use of a Micro Air Vehicle to Track and Avoid Adversaries , 2010, Int. J. Robotics Res..

[19]  Vijay Kumar,et al.  A Framework and Architecture for Multi-Robot Coordination , 2000, ISER.

[20]  Christine K. Eun,et al.  A microfabricated steel and glass radiation detector with inherent wireless signaling , 2010 .

[21]  David Hyunchul Shim,et al.  Multi-functional autopilot design and experiments for rotorcraft-based unmanned aerial vehicles , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[22]  S. Shankar Sastry,et al.  Markov Chain Monte Carlo Data Association for Multi-Target Tracking , 2009, IEEE Transactions on Automatic Control.

[23]  S. Shankar Sastry,et al.  Fusion-based localization for a Heterogeneous camera network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[24]  Gaurav S. Sukhatme,et al.  Connecting the Physical World with Pervasive Networks , 2002, IEEE Pervasive Comput..

[25]  S. Kim,et al.  Trio: enabling sustainable and scalable outdoor wireless sensor network deployments , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[26]  Fiorenzo Franceschini,et al.  A review of localization algorithms for distributed wireless sensor networks in manufacturing , 2009, Int. J. Comput. Integr. Manuf..

[27]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[28]  S. Shankar Sastry,et al.  An External Active-Set Strategy for Solving Optimal Control Problems , 2009, IEEE Transactions on Automatic Control.

[29]  Shuang-Hua Yang,et al.  Indoor Localization Systems — Tracking Objects and Personnel with Sensors, Wireless Networks and RFID , 2009 .

[30]  S. Shankar Sastry,et al.  Pursuit-evasion games with unmanned ground and aerial vehicles , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[31]  Kristofer S. J. Pister,et al.  TSMP: TIME SYNCHRONIZED MESH PROTOCOL , 2008 .

[32]  Khalil Najafi,et al.  Electrostatically driven micro-hydraulic actuator arrays , 2010, 2010 IEEE 23rd International Conference on Micro Electro Mechanical Systems (MEMS).

[33]  S. Shankar Sastry,et al.  Tracking and Coordination of Multiple Agents Using Sensor Networks: System Design, Algorithms and Experiments , 2007, Proceedings of the IEEE.

[34]  Kensall D. Wise,et al.  A low power , high-speed miniaturized thermal modulator for comprehensive 2 D gas chromatography , 2009 .

[35]  Hyeokho Choi,et al.  Distributed camera network localization , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[36]  P. Gill,et al.  User's Guide for SOL/NPSOL: A Fortran Package for Nonlinear Programming. , 1983 .

[37]  Vijay Kumar,et al.  Cooperative manipulation and transportation with aerial robots , 2009, Auton. Robots.

[38]  Allen Y. Yang,et al.  CITRIC: A low-bandwidth wireless camera network platform , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[39]  Mac Schwager,et al.  Decentralized, Adaptive Coverage Control for Networked Robots , 2009, Int. J. Robotics Res..

[40]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[41]  Hamid Gharavi,et al.  Special issue on sensor networks and applications , 2003 .

[42]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[43]  J. Karl Hedrick,et al.  Linear Tracking for a Fixed-Wing UAV Using Nonlinear Model Predictive Control , 2009, IEEE Transactions on Control Systems Technology.

[44]  P.K. Varshney,et al.  Decision fusion rules in multi-hop wireless sensor networks , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[45]  Mike Horton,et al.  The platforms enabling wireless sensor networks , 2004, CACM.

[46]  Kensall D. Wise,et al.  A low power, high-speed miniaturized thermal modulator for comprehensive 2D gas chromatography , 2010, 2010 IEEE 23rd International Conference on Micro Electro Mechanical Systems (MEMS).

[47]  S. Shankar Sastry,et al.  Wireless sensor network metrics for real-time systems , 2009 .

[48]  C. Guestrin,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[49]  Yasamin Mostofi,et al.  Decentralized Communication-Aware Motion Planning in Mobile Networks: An Information-Gain Approach , 2009, J. Intell. Robotic Syst..

[50]  S. Shankar Sastry,et al.  A Situation-aware Flight Control System Design using Real-time Model Predictive Control for Unmanned Autonomous Helicopters , 2006 .

[51]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[52]  Ren-Guey Lee,et al.  A TELE-EMERGENT SYSTEM FOR LONG-TERM ECG MONITORING OVER WIRELESS SENSOR NETWORK , 2007 .

[53]  Ankur Mehta,et al.  WARPWING: A complete open source control platform for miniature robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  S. Shankar Sastry,et al.  Automatic Camera Network Localization using Object Image Tracks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[55]  William M. Healy,et al.  Wireless sensor network performance metrics for building applications , 2010 .

[56]  James Black,et al.  Multi view image surveillance and tracking , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[57]  Samuel Burden,et al.  Bio-inspired design and dynamic maneuverability of a minimally actuated six-legged robot , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[58]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[59]  S. Shankar Sastry,et al.  A flight control system for aerial robots: algorithms and experiments , 2002 .

[60]  P. Gill,et al.  Fortran package for nonlinear programming. User's Guide for NPSOL (Version 4. 0) , 1986 .

[61]  S. Shankar Sastry,et al.  Conflict-free navigation in unknown urban environments , 2006, IEEE Robotics & Automation Magazine.

[62]  David Hyunchul Shim,et al.  System Identification and Control Synthesis for Rotorcraft-based Unmanned Aerial Vehicles , 2000 .

[63]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[64]  M. H. Dickinson,et al.  Development of micromechanics for micro-autonomous systems (ARL-MAST CTA Program) , 2009, Defense + Commercial Sensing.

[65]  S. Shankar Sastry,et al.  Decentralized nonlinear model predictive control of multiple flying robots , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[66]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2005, SIAM Rev..

[67]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[68]  Gaurav S. Sukhatme,et al.  Adaptive teams of autonomous aerial and ground robots for situational awareness , 2007, J. Field Robotics.

[69]  Ronald S. Fearing,et al.  Systematic study of the performance of small robots on controlled laboratory substrates , 2010, Defense + Commercial Sensing.

[70]  S. Shankar Sastry,et al.  HIERARCHICAL CONTROL SYSTEM SYNTHESIS FOR ROTORCRAFT-BASED UNMANNED AERIAL VEHICLES , 2000 .

[71]  K. Schittkowski On the Convergence of a Sequential Quadratic Programming Method with an Augmented Lagrangian Line Search Functions. , 1982 .

[72]  A. T. Dinh-Xuan,et al.  From the authors , 2005, European Respiratory Journal.

[73]  Narendra Ahuja,et al.  Gross motion planning—a survey , 1992, CSUR.

[74]  Rita Cucchiara,et al.  A system for automatic face obscuration for privacy purposes , 2006 .

[75]  Ali M. Shatnawi,et al.  Intelligent Traffic Light Flow Control System Using Wireless Sensors Networks , 2010, J. Inf. Sci. Eng..

[76]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[77]  Bruno Sinopoli,et al.  Distributed control applications within sensor networks , 2003, Proc. IEEE.

[78]  Subhransu Maji,et al.  Distributed compression and fusion of nonnegative sparse signals for multiple-view object recognition , 2009, 2009 12th International Conference on Information Fusion.