Cooperative target tracking using mobile robots

We study the problem of multiple target tracking using multiple mobile robots. Our approach is to divide the cooperative multi-target tracking problem into two sub-problems: target tracking using a single mobile robot and on-line motion strategy design for multi-robot coordination. For single robot-based tracking, we address two key challenges: how to separate the ego-motion of the robot from the motions of external objects, and how to compensate this ego-motion to detect and track moving objects robustly. An ego-motion compensation method using salient feature tracking and a probabilistic filter design to handle the noise and uncertainty of sensor inputs are presented. The proposed method has been tested in various outdoor environments using three different robot platforms, which have unique ego-motion characteristics. For multi-robot coordination, we propose an algorithm based on treating the densities of robots and targets as properties of the environment in which they are embedded. By suitably manipulating these densities a control law for each robot is proposed; we term our approach Region-based. We derive two specialized versions of the control law for the case when the topology of the environment is known in advance and the case when the environment is unstructured. These coordination approaches have been tested in simulation and in real robot systems. Experiments indicate that our treatment of the coordination problem based on environmental characteristics is effective and efficient.

[1]  R. Danchick,et al.  A fast method for finding the exact N-best hypotheses for multitarget tracking , 1993 .

[2]  Hyun Seung Yang,et al.  Fast and effective multiple moving targets tracking method for mobile robots , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[3]  Y. Bar-Shalom,et al.  Multisensor tracking of a maneuvering target in clutter , 1989 .

[4]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[5]  Universityof SouthernCalifornia LosAngeles Laser-based People Tracking , 2002 .

[6]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[7]  Gregory Dudek,et al.  Collaborative exploration for the construction of visual maps , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[8]  Frans C. A. Groen,et al.  Motion interpretation for in-car vision systems , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[10]  D. J. DiFilippo,et al.  Design and implementation of a tracking algorithm for active missile approach warning systems , 1995, Proceedings 1995 Canadian Conference on Electrical and Computer Engineering.

[11]  Yaakov Bar-Shalom,et al.  Multitarget/Multisensor Tracking: Applications and Advances -- Volume III , 2000 .

[12]  Masafumi Yamashita,et al.  Searching for Mobile Intruders in a Polygonal Region by a Group of Mobile Searchers , 2001, SCG '97.

[13]  Masafumi Yamashita,et al.  Searching for Mobile Intruders in a Polygonal Region by a Group of Mobile Searchers (Extended Abstract) , 1997, Symposium on Computational Geometry.

[14]  Gaurav S. Sukhatme,et al.  A tale of two helicopters , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[15]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[16]  Shashi Phoha,et al.  Tracking targets with self-organizing distributed ground sensors , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[17]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[18]  Tomas Uhlin,et al.  Closing the loop: detection and pursuit of a moving object by a moving observer , 1996, Image Vis. Comput..

[19]  Gaurav S. Sukhatme,et al.  Cooperative Tracking with Mobile Robots and Networked Embedded Sensors , 2001 .

[20]  A. Yilmaz,et al.  TARGET-TRACKING IN FLIR IMAGERY USING MEAN-SHIFT AND GLOBAL MOTION COMPENSATION , 2001 .

[21]  Maja J. Mataric,et al.  Broadcast of Local Elibility for Multi-Target Observation , 2000, DARS.

[22]  Yu Hen Hu,et al.  Detection, classification, and tracking of targets , 2002, IEEE Signal Process. Mag..

[23]  Rachid Deriche,et al.  Using geometric corners to build a 2D mosaic from a set of images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  David Liu,et al.  Target tracking in an environment of nearly stationary and biased clutter , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[25]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1997, J. Intell. Robotic Syst..

[26]  Yaakov Bar-Shalom,et al.  Multitarget-multisensor tracking: Advanced applications , 1989 .

[27]  Leonidas J. Guibas,et al.  A dual-space approach to tracking and sensor management in wireless sensor networks , 2002, WSNA '02.

[28]  Larry S. Davis,et al.  W4S: A real-time system detecting and tracking people in 2 1/2D , 1998, ECCV.

[29]  Tucker R. Balch,et al.  Distributed sensor fusion for object position estimation by multi-robot systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[30]  Norikazu Ikoma,et al.  Maneuvering Target Tracking by using Particle Filter Method with Model Switching Structure , 2002, COMPSTAT.

[31]  Wang-Chien Lee,et al.  On localized prediction for power efficient object tracking in sensor networks , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..

[32]  Geoffrey J. Gordon,et al.  Finding Approximate POMDP solutions Through Belief Compression , 2011, J. Artif. Intell. Res..

[33]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[34]  Iwan Ulrich,et al.  VFH+: reliable obstacle avoidance for fast mobile robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[35]  Camillo J. Taylor,et al.  Dynamic Sensor Planning and Control for Optimally Tracking Targets , 2003, Int. J. Robotics Res..

[36]  Gaurav S. Sukhatme,et al.  Incremental online topological map building with a mobile robot , 1999, Optics East.

[37]  Gérard G. Medioni,et al.  Detecting and tracking moving objects for video surveillance , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[38]  Christian Micheloni,et al.  A robust feature tracker for active surveillance of outdoor scenes , 2003, ELCVIA Electronic Letters on Computer Vision and Image Analysis.

[39]  T. Song,et al.  A passive tracking filter for missile capture , 1990 .

[40]  Héctor H. González-Baños,et al.  Motion strategies for maintaining visibility of a moving target , 1997, Proceedings of International Conference on Robotics and Automation.

[41]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[43]  Craig Boutilier,et al.  Computing Optimal Policies for Partially Observable Decision Processes Using Compact Representations , 1996, AAAI/IAAI, Vol. 2.

[44]  Lynne E. Parker Cooperative motion control for multi-target observation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[45]  Yaakov Bar-Shalom,et al.  Passive ranging of a low observable ballistic missile in a gravitational field , 2001 .

[46]  S. S. Blackman,et al.  Association and Fusion of Multiple Sensor Data , 1990 .

[47]  Leonidas J. Guibas,et al.  Sensing, tracking and reasoning with relations , 2002, IEEE Signal Process. Mag..

[48]  George A. Biernson Optimal Radar Tracking Systems , 1990 .

[49]  Gaurav S. Sukhatme,et al.  A generalized region-based approach for multi-target tracking in outdoor environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[50]  C. Hue,et al.  A particle filter to track multiple objects , 2001, Proceedings 2001 IEEE Workshop on Multi-Object Tracking.

[51]  Guohong Cao,et al.  Optimizing tree reconfiguration for mobile target tracking in sensor networks , 2004, IEEE INFOCOM 2004.

[52]  Howie Choset,et al.  Sensor Based Planing, Part II: Incremental COnstruction of the Generalized Voronoi Graph , 1995, ICRA.

[53]  Gaurav S. Sukhatme,et al.  Robot box-pushing with environment-embedded sensors , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[54]  Héctor H. González-Baños,et al.  Tracking an unpredictable target among occluding obstacles under localization uncertainties , 2002, Robotics Auton. Syst..

[55]  Andrea Fusiello,et al.  Image stabilization by features tracking , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[56]  Fredrik Gustafsson,et al.  Particle filters for positioning, navigation, and tracking , 2002, IEEE Trans. Signal Process..

[57]  Gaurav S. Sukhatme,et al.  A region-based approach for cooperative multi-target tracking in a structured environment , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[58]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[59]  Erwin Prassler,et al.  Fast and robust tracking of multiple moving objects with a laser range finder , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[60]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[61]  Philip L. Bogler,et al.  Radar Principles with Applications to Tracking Systems , 1990 .

[62]  Yoshiaki Shirai,et al.  Real-time omnidirectional stereo for obstacle detection and tracking in dynamic environments , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[63]  Samuel S. Blackman,et al.  Multiple-Target Tracking with Radar Applications , 1986 .

[64]  F. Ade,et al.  Using the condensation algorithm to implement tracking for mobile robots , 1999, 1999 Third European Workshop on Advanced Mobile Robots (Eurobot'99). Proceedings (Cat. No.99EX355).

[65]  Illah R. Nourbakhsh,et al.  Automatic Mapping of Dynamic Office Environments , 1999, Auton. Robots.

[66]  Wolfram Burgard,et al.  A Probabilistic Approach to Concurrent Mapping and Localization for Mobile Robots , 1998, Auton. Robots.

[67]  Gaurav S. Sukhatme,et al.  Staying alive: a docking station for autonomous robot recharging , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[68]  Gaurav S. Sukhatme,et al.  Tracking Multiple Moving Targets using a Camera and Laser Rangefinder , 2001 .

[69]  Gaurav S. Sukhatme,et al.  Online simultaneous localization and mapping in dynamic environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[70]  Leonidas J. Guibas,et al.  A Visibility-Based Pursuit-Evasion Problem , 1999, Int. J. Comput. Geom. Appl..

[71]  Gaurav S. Sukhatme,et al.  Staying Alive Longer: Autonomous Robot Recharging Put to the Test , 2003 .

[72]  Y. Bar-Shalom,et al.  Tracking a maneuvering target using input estimation versus the interacting multiple model algorithm , 1989 .

[73]  Victor R. Lesser,et al.  Distributed sensor network for real time tracking , 2001, AGENTS '01.

[74]  Larry S. Davis,et al.  W4S : A real-time system for detecting and tracking people in 2 D , 1998, eccv 1998.

[75]  Akbar M. Sayeed,et al.  Detection, Classification and Tracking of Targets in Distributed Sensor Networks , 2002 .

[76]  Maja J. Mataric,et al.  Principled Communication for Dynamic Multi-robot Task Allocation , 2000, ISER.

[77]  R. L. Cooperman,et al.  Tactical ballistic missile tracking using the interacting multiple model algorithm , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[78]  Gaurav S. Sukhatme,et al.  Relaxation on a mesh: a formalism for generalized localization , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[79]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[80]  Stergios I. Roumeliotis,et al.  3-D Localization for a Mars Rover Prototype , 1999 .

[81]  L. Davis,et al.  W 4 S: a Real-time System for Detecting and Tracking People in 2 1 2 D , 1998 .

[82]  Y. Bar-Shalom Tracking and data association , 1988 .

[83]  Michael O. Kolawole,et al.  Radar Systems, Peak Detection And Tracking , 2002 .

[84]  Leslie Pack Kaelbling,et al.  Representing hierarchical POMDPs as DBNs for multi-scale robot localization , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[85]  H. Choset,et al.  Toward robust sensor based exploration by constructing reduced generalized Voronoi graph , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[86]  Ronald E. Parr,et al.  Solving Factored POMDPs with Linear Value Functions , 2001 .

[87]  Gaurav S. Sukhatme,et al.  Most valuable player: a robot device server for distributed control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[88]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[89]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[90]  Wolfram Burgard,et al.  Tracking multiple moving targets with a mobile robot using particle filters and statistical data association , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[91]  Isaac Cohen,et al.  Continuous multi-views tracking using tensor voting , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[92]  Gaurav S. Sukhatme,et al.  Landmark-based Matching Algorithm for Cooperative Mapping by Autonomous Robots , 2000, DARS.

[93]  John K. Goutsias,et al.  Automatic target detection and tracking in forward-looking infrared image sequences using morphological connected operators , 2004, J. Electronic Imaging.

[94]  Lynne E. Parker,et al.  Cooperative Robotics for Multi-Target Observation , 1999, Intell. Autom. Soft Comput..

[95]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[96]  Shawn Michael Herman,et al.  A Particle Filtering Approach to Joint Passive Radar Tracking and Target Classification , 2002 .

[97]  Roland Siegwart,et al.  Simultaneous localization and map building: a global topological model with local metric maps , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[98]  Gaurav S. Sukhatme,et al.  Tracking Anonymous Targets using a Robotics Sensor Network , 2002 .

[99]  Anup Basu,et al.  Motion Tracking with an Active Camera , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[100]  Mateu Sbert,et al.  Some Integral Geometry Tools to Estimate the Complexity of 3D Scenes , 1996 .

[101]  Patrick Pérez,et al.  Sequential Monte Carlo methods for multiple target tracking and data fusion , 2002, IEEE Trans. Signal Process..

[102]  Pierre Bessière,et al.  Chasing an elusive target with a mobile robot , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[103]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[104]  Ali Shahrokni,et al.  A Robust Vision-based Moving Target Detection and Tracking System , 2001 .

[105]  Peter S. Maybeck,et al.  Target tracking using infrared measurements and laser illumination , 1994 .

[106]  G.M. Siouris,et al.  Tracking an incoming ballistic missile using an extended interval Kalman filter , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[107]  Gaurav S. Sukhatme,et al.  Cooperative tracking using mobile robots and environment-embedded, networked sensors , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[108]  William Whittaker,et al.  Conditional particle filters for simultaneous mobile robot localization and people-tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[109]  William Fitzgerald,et al.  A Bayesian approach to tracking multiple targets using sensor arrays and particle filters , 2002, IEEE Trans. Signal Process..

[110]  J.-S. Gutmann,et al.  AMOS: comparison of scan matching approaches for self-localization in indoor environments , 1996, Proceedings of the First Euromicro Workshop on Advanced Mobile Robots (EUROBOT '96).

[111]  Irfan Essa,et al.  A System for Tracking and Recognizing Multiple People with Multiple Cameras , 1998 .

[112]  Gaurav S. Sukhatme,et al.  Tracking Targets Using Multiple Robots: The Effect of Environment Occlusion , 2002, Auton. Robots.

[113]  Nikos A. Vlassis,et al.  Perseus: Randomized Point-based Value Iteration for POMDPs , 2005, J. Artif. Intell. Res..

[114]  George W. Irwin,et al.  Manoeuvring Target Tracking Using a Multiple-Model Bootstrap Filter , 2001, Sequential Monte Carlo Methods in Practice.

[115]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[116]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[117]  Andrew W. Moore,et al.  Very Fast EM-Based Mixture Model Clustering Using Multiresolution Kd-Trees , 1998, NIPS.

[118]  Horst-Michael Gross,et al.  Sensor Fusion for Vision and Sonar Based People Tracking on a Mobile Service Robot , 2002 .

[119]  Michal Irani,et al.  Recovery of ego-motion using image stabilization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[120]  Gaurav S. Sukhatme,et al.  Detecting Moving Objects using a Single Camera on a Mobile Robot in an Outdoor Environment , 2004 .

[121]  Yaakov Bar-Shalom,et al.  Sonar tracking of multiple targets using joint probabilistic data association , 1983 .

[122]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[123]  Alex Brooks,et al.  Tracking People with Networks of Heterogeneous Sensors , 2003 .

[124]  Feng Zhao,et al.  Information-Driven Dynamic Sensor Collaboration for Tracking Applications , 2002 .

[125]  Héctor H. González-Baños,et al.  A reactive motion planner to maintain visibility of unpredictable targets , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[126]  Howie Choset,et al.  Sensor Based Planing, Part I: The Generalized Voronoi Graph , 1995, ICRA.

[127]  Alonzo Kelly,et al.  A 3D State Space Formulation of a Navigation Kalman Filter for Autonomous Vehicles , 1994 .

[128]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[129]  Rama Chellappa,et al.  Image stabilization and mosaicking using the overlapped basis optical flow field , 1997, Proceedings of International Conference on Image Processing.