Laser and Radar Based Robotic Perception

Perceptive laser and radar sensors provide information from the surrounding environment and are a critical aspect of many robotics applications. These sensors are generally subject to many sources of uncertainty, namely detection and data association uncertainty, spurious measurements, biases as well as measurement noise. To deal with such uncertainty, probabilistic methods are most widely adopted. These probabilistic environmental representations, for autonomous navigation frameworks with uncertain measurements, can generally be subdivided into two main categories — grid based (GB) and feature based (FB). GB approaches are popular for robotic exploration, obstacle avoidance and path planning, whereas FB maps, with their reduced dimensionality, are primarily used for large scale robotic navigation and simultaneous localization and map building (SLAM). While researchers commonly distinguish both approaches based on their environmental representations, this paper examines the fundamental, theoretical aspects of the estimation theoretic algorithms for both approaches. Emphasis on the measurement likelihoods is used to incorporate measurement uncertainty, and their impact on the resulting stochastic formulations is examined. This paper also explores the front-ends of commonly used laser and radar sensors to develop an in-depth understanding of inherent measurement uncertainty. In this monograph, perceptive uncertainty is largely categorized into that related to signal detection and range measuring. While range noise is commonly addressed in the robotics literature, there is less emphasis placed on detection uncertainty and its subsequent impact on stochastic robotic perception algorithms. As such, following a signal level analysis of both laser and radar range finders, this paper addresses stochastic measurement modeling and map representations. In particular, occupancy grid methods based on spatial statistics are reviewed as well as those more recently based on detection statistics. Recent work, which proposes that the occupancy state space is more appropriately propagated by applying the discrete Bayes recursion using estimates of the detection and false alarm probabilities, as opposed to the commonly used range measurement likelihoods, is discussed. A review of FB perception methods is presented, with particular attention to the important fields of robotic mapping and SLAM. In particular, comparisons of state-of-the-art Gaussian, Gaussian mixture, and nonparametric map representations are given, demonstrating the assumptions and advantages of each technique. Finally, recent FB frameworks using random finite sets are reviewed in which the measurement model is generalized to include detection uncertainty and the feature map representation is generalized to incorporate uncertainty in the number of features present. These recent developments add a new direction to the well-studied problem of robotic perception and the estimation of any given environment.

[1]  Hanumant Singh,et al.  Exactly Sparse Delayed-State Filters for View-Based SLAM , 2006, IEEE Transactions on Robotics.

[2]  Wolfram Burgard,et al.  Efficiently learning high-dimensional observation models for Monte-Carlo localization using Gaussian mixtures , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Antonio Reina,et al.  Characterization of a radial laser scanner for mobile robot navigation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[4]  Graham M. Brooker,et al.  Application of Millimetre Wave Radar Sensor to Environment Mapping in Surface Mining , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[5]  Kurt Konolige,et al.  Incremental mapping of large cyclic environments , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[6]  Ronald P. S. Mahler,et al.  Approximate multisensor CPHD and PHD filters , 2010, 2010 13th International Conference on Information Fusion.

[7]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[8]  Michael Bosse,et al.  Simultaneous Localization and Map Building in Large-Scale Cyclic Environments Using the Atlas Framework , 2004, Int. J. Robotics Res..

[9]  Sebastian Thrun,et al.  Learning Occupancy Grid Maps with Forward Sensor Models , 2003, Auton. Robots.

[10]  Martin David Adams,et al.  Pose invariant, robust feature extraction from data with a modified scale space approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[11]  A. Doucet,et al.  Sequential Monte Carlo methods for multitarget filtering with random finite sets , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Ba-Ngu Vo,et al.  Random Finite Sets for Robot Mapping and SLAM - New Concepts in Autonomous Robotic Map Representations , 2011, Springer Tracts in Advanced Robotics.

[13]  Alberto Elfes,et al.  Occupancy grids: a probabilistic framework for robot perception and navigation , 1989 .

[14]  Wolfram Burgard,et al.  Gaussian Beam Processes: A Nonparametric Bayesian Measurement Model for Range Finders , 2007, Robotics: Science and Systems.

[15]  Cyrill Stachniss,et al.  Hierarchical optimization on manifolds for online 2D and 3D mapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Ba-Ngu Vo,et al.  Tracking multiple speakers using random sets , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[18]  Sebastian Thrun,et al.  Exploration and model building in mobile robot domains , 1993, IEEE International Conference on Neural Networks.

[19]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[20]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[21]  Martin David Adams,et al.  Toward multidimensional assignment data association in robot localization and mapping , 2006, IEEE Transactions on Robotics.

[22]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[23]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[24]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[25]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[26]  Martin David Adams,et al.  Robotic Mapping Using Measurement Likelihood Filtering , 2009, Int. J. Robotics Res..

[27]  Martin David Adams,et al.  Including probabilistic target detection attributes into map representations , 2007, Robotics Auton. Syst..

[28]  Matthew R. Walter,et al.  Exactly Sparse Extended Information Filters for Feature-based SLAM , 2007, Int. J. Robotics Res..

[29]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[30]  Gabriel Lorimer Miller,et al.  An Optical Rangefinder For Autonomous Robot Cart Navigation , 1987, Other Conferences.

[31]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[32]  Ba-Ngu Vo,et al.  Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter , 2007, IEEE Transactions on Signal Processing.

[33]  John Stephen. Mullane,et al.  Autonomous navigation: on issues concerning measurement uncertainty. , 2009 .

[34]  R. Mahler,et al.  PHD filters of higher order in target number , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[35]  Takeo Kanade,et al.  Three-Dimensional Machine Vision , 1987 .

[36]  Gamini Dissanayake,et al.  D-SLAM: A Decoupled Solution to Simultaneous Localization and Mapping , 2007, Int. J. Robotics Res..

[37]  Ingemar J. Cox,et al.  Dynamic Map Building for an Autonomous Mobile Robot , 1992 .

[38]  Aaron D. Lanterman,et al.  Probability hypothesis density-based multitarget tracking with bistatic range and Doppler observations , 2005 .

[39]  William Fitzgerald,et al.  A Bayesian approach to tracking multiple targets using sensor arrays and particle filters , 2002, IEEE Trans. Signal Process..

[40]  Stefan B. Williams Efficient Solutions to Autonomous Mapping and Navigation Problems , 2009 .

[41]  Saleem A. Kassam,et al.  Analysis of CFAR processors in homogeneous background , 1988 .

[42]  Simon Lacroix,et al.  Autonomous Rover Navigation on Unknown Terrains: Functions and Integration , 2000, Int. J. Robotics Res..

[43]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[44]  A. E. Brain,et al.  The measurement and use of registered reflectance and range data in scene analysis , 1977, Proceedings of the IEEE.

[45]  B. Vo,et al.  Random Finite Sets for Robot Mapping and SLAM: New Concepts in Robotic Mapping Representations , 2011 .

[46]  K. Arras Feature-based robot navigation in known and unknown environments , 2003 .

[47]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[48]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[49]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[50]  H. Durrant-Whyte,et al.  Mobile vehicle navigation in unknown environments: a multiple hypothesis approach , 1995 .

[51]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization and Mapping with Sparse Extended Information Filters , 2004, Int. J. Robotics Res..

[52]  B. Vo,et al.  A closed-form solution for the probability hypothesis density filter , 2005, 2005 7th International Conference on Information Fusion.

[53]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[54]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[55]  Martin David Adams,et al.  An augmented state SLAM formulation for multiple line-of-sight features with millimetre wave RADAR , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Hedvig Kjellström,et al.  Multi-target particle filtering for the probability hypothesis density , 2003, ArXiv.

[57]  Hugh F. Durrant-Whyte,et al.  A Bayesian Algorithm for Simultaneous Localisation and Map Building , 2001, ISRR.

[58]  Penny Probert Smith,et al.  Active Triangulation Rangefinder Design For Mobile Robots , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Barnabas Takacs,et al.  Real-time visualization using a 2D/3D imaging MMWave radar , 2004, IS&T/SPIE Electronic Imaging.

[60]  Ba-Ngu Vo,et al.  Convergence Analysis of the Gaussian , 2007 .

[61]  Ba-Ngu Vo,et al.  A random set formulation for Bayesian SLAM , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[62]  N. Ikoma,et al.  Tracking of feature points in image sequence by SMC implementation of PHD filter , 2004, SICE 2004 Annual Conference.

[63]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Sebastian Thrun,et al.  Learning occupancy grids with forward models , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[65]  Perera Linthotage Dushantha Lochana On the issues of localization and mapping in outdoor unstructured environments for mobile robot navigation , 2007 .

[66]  Hans P. Moravec,et al.  Robot Evidence Grids. , 1996 .

[67]  Wijerupage Sardha Wijesoma,et al.  Pose Invariant , Robust Feature Extraction From Range Data With a Modi fi ed Scale Space Approach , 2004 .

[68]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[69]  Raman K. Mehra,et al.  Joint tracking and identification with robustness against unmodeled targets , 2003, SPIE Defense + Commercial Sensing.

[70]  Gamini Dissanayake,et al.  Simultaneous localisation and map building using millimetre wave radar to extract natural features , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[71]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[72]  Hedvig Kjellström,et al.  Tracking Random Sets of Vehicles in Terrain , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[73]  L. M. Peterson,et al.  Laser radar in robotics , 1996 .

[74]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[75]  Martin David Adams,et al.  The Estimation Theoretic Sensor Bias Correction Problem in Map Aided Localization , 2006, Int. J. Robotics Res..

[76]  Kurt Konolige,et al.  Improved Occupancy Grids for Map Building , 1997, Auton. Robots.

[77]  J. Bares,et al.  Three-Dimensional Map Building with MMW Radar , 2003 .

[78]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[79]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[80]  Ray A. Jarvis,et al.  A Laser Time-of-Flight Range Scanner for Robotic Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Udo Frese,et al.  Treemap: An O(log n) algorithm for indoor simultaneous localization and mapping , 2006, Auton. Robots.

[82]  Raja Chatila,et al.  Stochastic multisensory data fusion for mobile robot location and environment modeling , 1989 .

[83]  Sebastian Thrun,et al.  6D SLAM with an application in autonomous mine mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[84]  Matteo Golfarelli,et al.  Elastic correction of dead-reckoning errors in map building , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[85]  Steve Scheding,et al.  Terrain Imaging and Perception using Millimetre Wave Radar , 2002 .

[86]  Pere Ridao,et al.  Underwater SLAM in a marina environment , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[87]  Cang Ye,et al.  Characterization of a 2D laser scanner for mobile robot obstacle negotiation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[88]  Bingbing Liu,et al.  Range error detection caused by occlusion in non-coaxial LADARs for scene interpretation , 2005 .

[89]  Ba-Ngu Vo,et al.  Convergence Analysis of the Gaussian Mixture PHD Filter , 2007, IEEE Transactions on Signal Processing.

[90]  Martin David Adams,et al.  Evidential versus Bayesian Estimation for Radar Map Building , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[91]  Ba-Ngu Vo,et al.  A Random-Finite-Set Approach to Bayesian SLAM , 2011, IEEE Transactions on Robotics.

[92]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[93]  Larry H. Matthies,et al.  Integration of sonar and stereo range data using a grid-based representation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[94]  Martial Hebert,et al.  3D measurements from imaging laser radars: how good are they? , 1992, Image Vis. Comput..

[95]  Gamini Dissanayake,et al.  Tradeoffs in SLAM with Sparse Information Filters , 2007, FSR.

[96]  Martial Hebert,et al.  3-D measurements from imaging laser radars: how good are they? , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[97]  Wolfram Burgard,et al.  Nonlinear Constraint Network Optimization for Efficient Map Learning , 2009, IEEE Transactions on Intelligent Transportation Systems.

[98]  Timothy S. Bailey,et al.  Mobile Robot Localisation and Mapping in Extensive Outdoor Environments , 2002 .

[99]  Eduardo Mario Nebot,et al.  Real time data association for FastSLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[100]  E. Nebot,et al.  Autonomous Navigation and Map building Using Laser Range Sensors in Outdoor Applications , 2000 .

[101]  Sumeetpal S. Singh,et al.  Sequential monte carlo implementation of the phd filter for multi-target tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[102]  Graham Brooker,et al.  Millimetre Waves for Robotics , 2001 .

[103]  S. M. Tonissen,et al.  Maximum likelihood track-before-detect with fluctuating target amplitude , 1998 .

[104]  T. Mattfeldt Stochastic Geometry and Its Applications , 1996 .

[105]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[106]  Hermann Rohling,et al.  Radar CFAR Thresholding in Clutter and Multiple Target Situations , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[107]  Ronald Maher,et al.  A survey of PHD filter and CPHD filter implementations , 2007, SPIE Defense + Commercial Sensing.

[108]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[109]  T. Collins,et al.  Occupancy grid mapping: An empirical evaluation , 2007, 2007 Mediterranean Conference on Control & Automation.

[110]  Y. Bar-Shalom Tracking and data association , 1988 .

[111]  N. Patrikalakis,et al.  Predicting Millimeter Wave Radar Spectra for Autonomous Navigation , 2010, IEEE Sensors Journal.

[112]  Paul Newman,et al.  SLAM-Loop Closing with Visually Salient Features , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[113]  Tom Duckett,et al.  A multilevel relaxation algorithm for simultaneous localization and mapping , 2005, IEEE Transactions on Robotics.

[114]  Martin David Adams Sensor Modelling, Design and Data Processing for Autonomous Navigation , 1999, World Scientific Series in Robotics and Intelligent Systems.

[115]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .

[116]  Hugh F. Durrant-Whyte,et al.  A Low-level Fusion of Millimetre-Wave Radar and Nightvision Imaging for Enhanced Characterisation of a Cluttered Environment , 2001 .

[117]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[118]  Henrik I. Christensen,et al.  Graphical SLAM - a self-correcting map , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[119]  Sebastian Thrun,et al.  Simultaneous localization and mapping with unknown data association using FastSLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[120]  Hugh F. Durrant-Whyte,et al.  Autonomous land vehicle navigation using millimeter wave radar , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[121]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .