Playing Fetch with Your Robot: The Ability of Robots to Locate and Interact with Objects

The task addressed in this article is the localization of an unknown number of targets using a mobile robot equipped with a visual sensor. The estimation of the number of targets and their locations is done using a recursive Bayesian filter over random finite sets (RFSs), and the position of the robot is assumed to be known. We present a computationally tractable control law whereby the robot follows the gradient of mutual information between target locations and detections. The method is verified through real-world experimental trials, reliably detecting multiple targets and ignoring clutter obstacles.

[1]  Vincent Dupourqué,et al.  A robot operating system , 1984, ICRA.

[2]  Alexei Makarenko,et al.  Information based adaptive robotic exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Ben Grocholsky,et al.  Information-Theoretic Control of Multiple Sensor Platforms , 2002 .

[4]  R. Mahler.  Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[5]  A. Doucet,et al.  Sequential Monte Carlo methods for multitarget filtering with random finite sets , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[7]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[8]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[9]  Ba-Ngu Vo,et al.  Sensor control for multi-object state-space estimation using random finite sets , 2010, Autom..

[10]  Claire J. Tomlin,et al.  Mobile Sensor Network Control Using Mutual Information Methods and Particle Filters , 2010, IEEE Transactions on Automatic Control.

[11]  Mac Schwager,et al.  A scalable information theoretic approach to distributed robot coordination , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Ba-Ngu Vo,et al.  A Random-Finite-Set Approach to Bayesian SLAM , 2011, IEEE Transactions on Robotics.

[13]  Vijay Kumar,et al.  A Multi-robot Control Policy for Information Gathering in the Presence of Unknown Hazards , 2011, ISRR.

[14]  Ba-Ngu Vo,et al.  A Note on the Reward Function for PHD Filters with Sensor Control , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Chaouki T. Abdallah,et al.  Information Surfing for Radiation Map Building , 2011, Int. J. Robotics Autom..

[16]  Ba-Ngu Vo,et al.  Random Finite Sets for Robot Mapping and SLAM - New Concepts in Autonomous Robotic Map Representations , 2011, Springer Tracts in Advanced Robotics.

[17]  Fredrik Gustafsson,et al.  Road Intensity Based Mapping Using Radar Measurements With a Probability Hypothesis Density Filter , 2011, IEEE Transactions on Signal Processing.

[18]  Ba-Ngu Vo,et al.  Why Random Finite Sets , 2011 .

[19]  Vijay Kumar,et al.  A decentralized control policy for adaptive information gathering in hazardous environments , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[20]  Aveek Das,et al.  R-MASTIF: robotic mobile autonomous system for threat interrogation and object fetch , 2013, Electronic Imaging.

[21]  Vijay Kumar,et al.  Cooperative multi-target localization with noisy sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.