Autonomous robotic strategies for urban search and rescue

This dissertation proposes autonomous robotic strategies for urban search and rescue (USAR) which are map-based semi-autonomous robot navigation and fully-autonomous robotic search, tracking, localization and mapping (STLAM) using a team of robots. Since the prerequisite for these solutions is accurate robot localization in the environment, this dissertation first presents a novel grid-based scan-to-map matching technique for accurate simultaneous localization and mapping (SLAM). At every acquisition of a new scan and estimation of the robot pose, the proposed technique corrects the estimation error by matching the new scan to the globally defined grid map. To improve the accuracy of the correction, each grid cell of the map is represented by multiple normal distributions (NDs). The new scan to be matched to the map is also represented by NDs, which achieves the scan-to-map matching by the ND-to-ND matching. In the map-based semi-autonomous robot navigation strategy, a robot placed in an environment creates the map of the environment and sends it to the human operator at a distant location. The human operator then makes decisions based on the map and controls the robot via tele-operation. In case of communication loss, the robot semi-autonomously returns to the home position by inversely tracking its trajectory with additional optimal path planning. In the fully-autonomous robotic solution to USAR, multiple robots communicate one another while operating together as a team. The base station collects information from each robot and assigns tasks to the robots. Unlike the semi-autonomous strategy there is no control from the human operator. To further enhance the efficiency of their cooperation each member of the team specifically works on its own task. A series of numerical and experimental studies were conducted to demonstrate the applicability of the proposed solutions to USAR scenarios. The effectiveness of the scan-to-map matching with the multi-ND representation was confirmed by analyzing the error accumulation and by comparing with the single-ND representation. The applicability of the scan-to-map matching to the real SLAM problem was also verified in three different real environments. The results of the map-based semi-autonomous robot navigation showed the effectiveness of the approach as an immediately usable solution to USAR. The effectiveness of the proposed fully-autonomous solution was first confirmed by two real robots in a real environment. The cooperative performance of the strategy was further investigated using the developed platform- and hardware-in-the-loop simulator. The results showed significant potential as the future solution to USAR.

[1]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Evangelos E. Milios,et al.  Globally Consistent Range Scan Alignment for Environment Mapping , 1997, Auton. Robots.

[3]  Roland Siegwart,et al.  Scene recognition with omnidirectional vision for topological map using lightweight adaptive descriptors , 2009 .

[4]  Wai-Kiang Yeap,et al.  A Split & Merge Approach to Metric-Topological Map-Building , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  N. Kubota,et al.  Growing topological map for SLAM of mobile robots , 2008, 2008 SICE Annual Conference.

[6]  Thomas Bräunl,et al.  Combining configuration space and occupancy grid for robot navigation , 2001 .

[7]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[8]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[9]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[10]  Michael Bosse,et al.  ATLAS: a framework for large scale automated mapping and localization , 2004 .

[11]  Jeffrey K. Uhlmann,et al.  Building a million beacon map , 2001, SPIE Optics East.

[12]  Edwin Olson,et al.  Fast iterative alignment of pose graphs with poor initial estimates , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  Takashi Tsubouchi,et al.  A 3-D Scan Matching using Improved 3-D Normal Distributions Transform for Mobile Robotic Mapping , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Frank Dellaert,et al.  iSAM: Fast Incremental Smoothing and Mapping with Efficient Data Association , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[16]  Wolfram Burgard,et al.  A Tree Parameterization for Efficiently Computing Maximum Likelihood Maps using Gradient Descent , 2007, Robotics: Science and Systems.

[17]  Gordon Wyeth,et al.  A modified particle filter for simultaneous robot localization and landmark tracking in an indoor environment , 2004 .

[18]  Luis Montesano,et al.  Probabilistic scan matching for motion estimation in unstructured environments , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  H.F. Durrant-Whyte,et al.  A new approach for filtering nonlinear systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[20]  Don Ray Murray,et al.  Using Real-Time Stereo Vision for Mobile Robot Navigation , 2000, Auton. Robots.

[21]  Paul Newman,et al.  On the Structure and Solution of the Simultaneous Localisation and Map Building Problem , 1999 .

[22]  Hugh F. Durrant-Whyte,et al.  The element-based method - theory and its application to bayesian search and tracking - , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[24]  Avinash C. Kak,et al.  Vision-based navigation by a mobile robot with obstacle avoidance using single-camera vision and ultrasonic sensing , 1998, IEEE Trans. Robotics Autom..

[25]  Hugh F. Durrant-Whyte,et al.  Uncertain geometry in robotics , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[26]  Eduardo Mario Nebot,et al.  Consistency of the EKF-SLAM Algorithm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Peter Schneider,et al.  Linearization of rotations for globally consistent n-scan matching , 2010, 2010 IEEE International Conference on Robotics and Automation.

[28]  Geovany de Araújo Borges,et al.  Line Extraction in 2D Range Images for Mobile Robotics , 2004, J. Intell. Robotic Syst..

[29]  Tom Duckett,et al.  A multilevel relaxation algorithm for simultaneous localization and mapping , 2005, IEEE Transactions on Robotics.

[30]  Andrew Howard,et al.  Multi-robot Simultaneous Localization and Mapping using Particle Filters , 2005, Int. J. Robotics Res..

[31]  Ronald Parr,et al.  DP-SLAM: fast, robust simultaneous localization and mapping without predetermined landmarks , 2003, IJCAI 2003.

[32]  Alberto Elfes.  Dynamic control of robot perception using multi-property inference grids , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[33]  Wolfram Burgard,et al.  An efficient fastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[34]  José A. Castellanos,et al.  Linear time vehicle relocation in SLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[35]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[37]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[38]  Wolfram Burgard,et al.  A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[39]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[40]  Kurt Konolige,et al.  Incremental mapping of large cyclic environments , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[41]  Wan Kyun Chung,et al.  Data Association Using Visual Object Recognition for EKF-SLAM in Home Environment , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  William R. Corliss.  Teleoperators: Man's Machine Partners , 1972 .

[43]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[44]  Andrea Censi,et al.  An ICP variant using a point-to-line metric , 2008, 2008 IEEE International Conference on Robotics and Automation.

[45]  Jorge L. Martínez,et al.  Incremental closed-form solution to globally consistent 2D range scan mapping with two-step pose estimation , 2010, 2010 11th IEEE International Workshop on Advanced Motion Control (AMC).

[46]  José A. Castellanos,et al.  Mobile Robot Localization and Map Building: A Multisensor Fusion Approach , 2000 .

[47]  Gary R. Bradski,et al.  Detection of Drivable Corridors for Off-Road Autonomous Navigation , 2006, 2006 International Conference on Image Processing.

[48]  Alan C. Schultz,et al.  Unifying exploration, localization, navigation and planning through a common representation , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[49]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[50]  P. Newman,et al.  SLAM in large-scale cyclic environments using the Atlas framework , 2003 .

[51]  A. Elfes,et al.  Occupancy Grids: A Stochastic Spatial Representation for Active Robot Perception , 2013, ArXiv.

[52]  Wolfram Burgard,et al.  Towards Lazy Data Association in SLAM , 2003, ISRR.

[53]  John J. Leonard,et al.  Adaptive Mobile Robot Navigation and Mapping , 1999, Int. J. Robotics Res..

[54]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[55]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[56]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .

[57]  José A. Castellanos,et al.  Robocentric map joining: Improving the consistency of EKF-SLAM , 2007, Robotics Auton. Syst..

[58]  Andreas Birk,et al.  3D forward sensor modeling and application to occupancy grid based sensor fusion , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Gamini Dissanayake,et al.  Convergence analysis for extended Kalman filter based SLAM , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[60]  Joachim Hertzberg,et al.  Cached k-d tree search for ICP algorithms , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[61]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Eduardo Mario Nebot,et al.  Real time data association for FastSLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[63]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[64]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[65]  Sebastian Thrun,et al.  A Multi-Resolution Pyramid for Outdoor Robot Terrain Perception , 2004, AAAI.

[66]  Florent Lamiraux,et al.  Metric-based iterative closest point scan matching for sensor displacement estimation , 2006, IEEE Transactions on Robotics.

[67]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[68]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[69]  Nora Ripperda,et al.  MARKER-FREE REGISTRATION OF TERRESTRIAL LASER SCANS USING THE NORMAL DISTRIBUTION TRANSFORM , 2005 .

[70]  Tatsuo Arai,et al.  NDT scan matching method for high resolution grid map , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[71]  Jayantha Katupitiya,et al.  Line Segment Based Scan Matching for Concurrent Mapping and Localization of a Mobile Robot , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[72]  Wolfram Burgard,et al.  Occupancy Grid Models for Robot Mapping in Changing Environments , 2012, AAAI.

[73]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[74]  Sebastian Thrun,et al.  Learning occupancy grids with forward models , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[75]  Yoram Koren,et al.  Real-time obstacle avoidance for fast mobile robots in cluttered environments , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[76]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[77]  Se-Young Oh,et al.  A line feature based SLAM with low grade range sensors using geometric constraints and active exploration for mobile robot , 2008, Auton. Robots.

[78]  Javier Civera,et al.  1-point RANSAC for EKF-based Structure from Motion , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[79]  Timothy S. Bailey,et al.  Mobile Robot Localisation and Mapping in Extensive Outdoor Environments , 2002 .

[80]  Roland Siegwart,et al.  EKF-based 3D SLAM for structured environment reconstruction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[81]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[82]  Maria L. Gini,et al.  Using visual features to build topological maps of indoor environments , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[83]  Wendelin Feiten,et al.  Relocalisation by Partial Map Matching , 1998, Sensor Based Intelligent Robots.

[84]  Roland Siegwart,et al.  Appearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles , 2008, IEEE Transactions on Robotics.

[85]  Stergios I. Roumeliotis,et al.  Weighted range sensor matching algorithms for mobile robot displacement estimation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[86]  Sebastian Thrun,et al.  FastSLAM: An Efficient Solution to the Simultaneous Localization And Mapping Problem with Unknown Data , 2004 .

[87]  Wolfram Burgard,et al.  Recovering Particle Diversity in a Rao-Blackwellized Particle Filter for SLAM After Actively Closing Loops , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[88]  Andreas Geiger,et al.  Visual SLAM for autonomous ground vehicles , 2011, 2011 IEEE International Conference on Robotics and Automation.

[89]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[90]  D. Mount.  ANN Programming Manual , 1998 .

[91]  Masahiro Tomono,et al.  A SLAM based teleoperation and interface system for indoor environment reconnaissance in rescue activities , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).