A Review on Challenges of Autonomous Mobile Robot and Sensor Fusion Methods

Autonomous mobile robots are becoming more prominent in recent time because of their relevance and applications to the world today. Their ability to navigate in an environment without a need for physical or electro-mechanical guidance devices has made it more promising and useful. The use of autonomous mobile robots is emerging in different sectors such as companies, industries, hospital, institutions, agriculture and homes to improve services and daily activities. Due to technology advancement, the demand for mobile robot has increased due to the task they perform and services they render such as carrying heavy objects, monitoring, search and rescue missions, etc. Various studies have been carried out by researchers on the importance of mobile robot, its applications and challenges. This survey paper unravels the current literatures, the challenges mobile robot is being faced with. A comprehensive study on devices/sensors and prevalent sensor fusion techniques developed for tackling issues like localization, estimation and navigation in mobile robot are presented as well in which they are organised according to relevance, strengths and weaknesses. The study therefore gives good direction for further investigation on developing methods to deal with the discrepancies faced with autonomous mobile robot.

[1]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[2]  Lounis Adouane,et al.  Mobile Robot Navigation and Obstacles Avoidance Based on Planning and Re-Planning Algorithm , 2012, SyRoCo.

[3]  Ahmed Rebai,et al.  Dempster-Shafer Theory for the Prediction of Auxin-Response Elements (AuxREs) in Plant Genomes , 2018, BioMed research international.

[4]  Ramon Barber,et al.  Mobile Robot Navigation in Indoor Environments: Geometric, Topological, and Semantic Navigation , 2018 .

[5]  Jae-Young Pyun,et al.  Practical Fingerprinting Localization for Indoor Positioning System by Using Beacons , 2017, J. Sensors.

[6]  Tom Duckett,et al.  3D modeling of indoor environments by a mobile robot with a laser scanner and panoramic camera , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Óscar Martínez Mozos,et al.  Relational Model for Robotic Semantic Navigation in Indoor Environments , 2017, J. Intell. Robotic Syst..

[8]  Ehsan Sadeghian,et al.  Mobile robots path planning using ant colony optimization and Fuzzy Logic algorithms in unknown dynamic environments , 2013, 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE).

[9]  Karsten Berns,et al.  Use of an Autonomous Mobile Robot for Elderly Care , 2010, 2010 Advanced Technologies for Enhancing Quality of Life.

[10]  Franklin E White,et al.  Data Fusion Lexicon , 1991 .

[11]  Yakup Genc,et al.  Marker-less tracking for AR: a learning-based approach , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[12]  Hubert Roth,et al.  Data Fusion of Stereo Vision and Gyroscope for Estimation of Indoor Mobile Robot Orientation , 2012, CESCIT.

[13]  Angelo M. Sabatini,et al.  Extended Kalman Filter-Based Methods for Pose Estimation Using Visual, Inertial and Magnetic Sensors: Comparative Analysis and Performance Evaluation , 2013, Sensors.

[14]  Li Guanghui,et al.  An Artificial Landmark Design Based on Mobile Robot Localization and Navigation , 2011, 2011 Fourth International Conference on Intelligent Computation Technology and Automation.

[15]  Liqiang Feng,et al.  Navigating Mobile Robots: Systems and Techniques , 1996 .

[16]  Murat Köseoğlu,et al.  Design of an autonomous mobile robot based on ROS , 2017, 2017 International Artificial Intelligence and Data Processing Symposium (IDAP).

[17]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[18]  Eric W. Frew,et al.  Vision-aided inertial navigation on an uncertain map using a particle filter , 2009, 2009 IEEE International Conference on Robotics and Automation.

[19]  Zhongliang Jing,et al.  Homography estimation from planar contours in image sequence , 2010 .

[20]  Victor P. Nelson Fault-tolerant computing: fundamental concepts , 1990, Computer.

[21]  Tomislav Volaric,et al.  Different Applications of Mobile Robots in Education , 2017, ArXiv.

[22]  David Kortenkamp Perception for mobile robot navigation: A survey of the state of the art , 1994 .

[23]  Lixin Tang,et al.  Indoor navigation for mobile robots using memorized omni-directional images and robot's motion , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Uk-Youl Huh,et al.  Path Planning for Autonomous Mobile Robot Based on Safe Space , 2016 .

[25]  Farhad Shamsfakhr,et al.  Indoor mobile robot localization in dynamic and cluttered environments using artificial landmarks , 2019, Engineering Computations.

[26]  Nathan Michael,et al.  Environment model adaptation for mobile robot exploration , 2017, Autonomous Robots.

[27]  Liliane Pellegrin,et al.  Using decision fusion methods to improve outbreak detection in disease surveillance , 2019, BMC Medical Informatics and Decision Making.

[28]  Juan Andrade-Cetto,et al.  Topological map learning for a mobile robot in indoor environments , 2001 .

[29]  Jason Gu,et al.  Sensor fusion in mobile robot: some perspectives , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[30]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[31]  Frank Lingelbach,et al.  Path planning using probabilistic cell decomposition , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[32]  Ching-Hsien Hsu,et al.  An Accelerometer Based Approach for Indoor Localization , 2009, 2009 Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing.

[33]  Mingyu Gao,et al.  Vision System of Mobile Robot Combining Binocular and Depth Cameras , 2017, J. Sensors.

[34]  Thomas B. Schön,et al.  Robust real-time tracking by fusing measurements from inertial and vision sensors , 2007, Journal of Real-Time Image Processing.

[35]  Seyedali Mirjalili,et al.  Three-dimensional path planning for UCAV using an improved bat algorithm , 2016 .

[36]  Yi-Ping Hung,et al.  RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Wolfram Burgard,et al.  A real-time expectation-maximization algorithm for acquiring multiplanar maps of indoor environments with mobile robots , 2004, IEEE Transactions on Robotics and Automation.

[38]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[39]  František Duchoň,et al.  Localization of mobile robot using visual system , 2017 .

[40]  Henry Leung,et al.  Multisensor joint tracking and identification using particle filter and Dempster-Shafer fusion , 2012, 2012 15th International Conference on Information Fusion.

[41]  Shao-Wen Yang,et al.  On Solving Mirror Reflection in LIDAR Sensing , 2011, IEEE/ASME Transactions on Mechatronics.

[42]  Woojin Chung,et al.  Mobile robot localization using indistinguishable artificial landmarks , 2013, 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[43]  Tao Zhang,et al.  Vision-Based Pose Estimation From Points With Unknown Correspondences , 2014, IEEE Transactions on Image Processing.

[44]  Angelo M. Sabatini Variable-State-Dimension Kalman-Based Filter for Orientation Determination Using Inertial and Magnetic Sensors , 2012, Sensors.

[45]  F. N. Sibai,et al.  Evaluation of indoor mobile robot localization techniques , 2012, 2012 International Conference on Computer Systems and Industrial Informatics.

[46]  Thomas B. Schön,et al.  Modeling and Calibration of Inertial and Vision Sensors , 2010, Int. J. Robotics Res..

[47]  Christophe Macabiau,et al.  Review and classification of vision-based localisation techniques in unknown environments , 2014 .

[48]  Keith Marzullo,et al.  Tolerating failures of continuous-valued sensors , 1990, TOCS.

[49]  Mary Alatise,et al.  Pose estimation of a mobile robot using monocular vision and inertial sensors data , 2017, 2017 IEEE AFRICON.

[50]  Lei Guo,et al.  Particle filtering with applications in networked systems: a survey , 2016, Complex & Intelligent Systems.

[51]  Amit Konar,et al.  Distributed cooperative multi-robot path planning using differential evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[52]  J. Calado,et al.  A Bayesian grid method PCA-based for mobile robots localization in unstructured environments , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[53]  Éric Marchand,et al.  Pose Estimation for Augmented Reality: A Hands-On Survey , 2016, IEEE Transactions on Visualization and Computer Graphics.

[54]  Gerhard P. Hancke,et al.  Unimodal and Multimodal Biometric Sensing Systems: A Review , 2016, IEEE Access.

[55]  Thia Kirubarajan,et al.  Estimation and Decision Fusion: A Survey , 2006, 2006 IEEE International Conference on Engineering of Intelligent Systems.

[56]  A. Tanju Erdem,et al.  Fusing Inertial Sensor Data in an Extended Kalman Filter for 3D Camera Tracking , 2015, IEEE Transactions on Image Processing.

[57]  Kurt Konolige,et al.  Markov Localization using Correlation , 1999, IJCAI.

[58]  A. S. Andreyev,et al.  The motion control of a wheeled mobile robot , 2015 .

[59]  Kourosh Khoshelham,et al.  3D Modelling of interior spaces : learning the language of indoor architecture , 2014 .

[60]  Qing-An Zeng,et al.  Integrated Data Fusion Using Dempster-Shafer Theory , 2015, 2015 First International Conference on Computational Intelligence Theory, Systems and Applications (CCITSA).

[61]  Peng-Yung Woo,et al.  Mobile Robot Path Planning with Randomly Moving Obstacles and Goal , 2012 .

[62]  Huseyin Atakan Varol,et al.  Locomotion Strategy Selection for a Hybrid Mobile Robot Using Time of Flight Depth Sensor , 2015, J. Sensors.

[63]  Prashanth Swamy,et al.  An Improved Tracking using IMU and Vision Fusion for Mobile Augmented Reality Applications , 2014, ArXiv.

[64]  Renato Zaccaria,et al.  Planning and obstacle avoidance in mobile robotics , 2012, Robotics Auton. Syst..

[65]  Fernando V. Coito,et al.  Tracking a Mobile Robot Position Using Vision and Inertial Sensor , 2014, DoCEIS.

[66]  Zhaokun Li,et al.  A new robust 2D camera calibration method using RANSAC , 2015 .

[67]  Md. Arafat Hossain,et al.  Autonomous robot path planning in dynamic environment using a new optimization technique inspired by Bacterial Foraging technique , 2014, 2013 International Conference on Electrical Information and Communication Technology (EICT).

[68]  Dayal R. Parhi,et al.  Navigation of underwater robot based on dynamically adaptive harmony search algorithm , 2016, Memetic Comput..

[69]  Carlos Llopis-Albert,et al.  A review of mobile robots: Concepts, methods, theoretical framework, and applications , 2019, International Journal of Advanced Robotic Systems.

[70]  Khuram Shahzad,et al.  Points-Based Safe Path Planning of Continuum Robots , 2015 .

[71]  蔡自兴,et al.  Design of dead reckoning system for mobile robot , 2006 .

[72]  J. Krejsa,et al.  Sensors Data Fusion via Bayesian Network , 2010 .

[73]  Gerhard P. Hancke,et al.  Air Quality Monitoring System Based on ISO/IEC/IEEE 21451 Standards , 2016, IEEE Sensors Journal.

[74]  Nitin Kumar,et al.  Autonomous Mobile Robots Designing , 2011 .

[75]  Federico Castanedo,et al.  A Review of Data Fusion Techniques , 2013, TheScientificWorldJournal.

[76]  Wook Bahn,et al.  Mobile robot vision tracking system using Unscented Kalman Filter , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[77]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..

[78]  Arcangelo Distante,et al.  An Autonomous Mobile Robotic System for Surveillance of Indoor Environments , 2010 .

[79]  Michael Suppa,et al.  Efficient next-best-scan planning for autonomous 3D surface reconstruction of unknown objects , 2013, Journal of Real-Time Image Processing.

[80]  Vincent Lepetit,et al.  Fast Keypoint Recognition in Ten Lines of Code , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[81]  Dayal R. Parhi,et al.  Mobile Robot Navigation and Obstacle Avoidance Techniques: A Review , 2017, ICRA 2017.

[82]  Yafei Ren,et al.  Particle Filter Data Fusion Enhancements for MEMS-IMU/GPS , 2010, Intell. Inf. Manag..

[83]  Stefan Borik,et al.  Device for Accelerometer and Gyroscope Measurements , 2014 .

[84]  David Hernández-López,et al.  A robust and hierarchical approach for the automatic co-registration of intensity and visible images , 2012 .

[85]  Ren C. Luo,et al.  A tutorial on multisensor integration and fusion , 1990, [Proceedings] IECON '90: 16th Annual Conference of IEEE Industrial Electronics Society.

[86]  Costas S. Tzafestas,et al.  Online Semantic Mapping of Urban Environments , 2012, Spatial Cognition.

[87]  Alberto Sanfeliu,et al.  Efficient Use of 3D Environment Models for Mobile Robot Simulation and Localization , 2010, SIMPAR.

[88]  Dilbag Singh,et al.  Multisensor Data Fusion and Integration for Mobile Robots: A Review , 2014, ICRA 2014.

[89]  T. T. Hoang,et al.  Multi-sensor perceptual system for mobile robot and sensor fusion-based localization , 2012, 2012 International Conference on Control, Automation and Information Sciences (ICCAIS).

[90]  Sahar Trigui,et al.  Introduction to Mobile Robot Path Planning , 2018 .

[91]  Markus Vincze,et al.  Simultaneous Motion and Structure Estimation by Fusion of Inertial and Vision Data , 2007, Int. J. Robotics Res..

[92]  L. Bailey The Kalman Filter , 2010 .

[93]  M. S. Bhat,et al.  Object detection and obstacle avoidance for mobile robot using stereo camera , 2013, 2013 IEEE International Conference on Control Applications (CCA).

[94]  Gen Endo,et al.  Study on Roller-Walker (multi-mode steering control and self-contained locomotion) , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[95]  Gang Zhang,et al.  Mobile Robot Localization Based on Extended Kalman Filter , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[96]  Wei Hong,et al.  Natural landmarks based localization algorithm for indoor robot with binocular vision , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[97]  Henry Leung,et al.  Mobile robot localization using odometry and kinect sensor , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[98]  Hugh F. Durrant-Whyte,et al.  Sensor Models and Multisensor Integration , 1988, Int. J. Robotics Res..

[99]  Alaa M. Khamis,et al.  Handling Data Uncertainty and Inconsistency Using Multisensor Data Fusion , 2013, Adv. Artif. Intell..

[100]  Pascal Vasseur,et al.  Introduction to Multisensor Data Fusion , 2005, The Industrial Information Technology Handbook.

[101]  Amit Konar,et al.  Energy efficient trajectory planning by a robot arm using invasive weed optimization technique , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.

[102]  Jaehwan Kim,et al.  UKF data fusion of odometry and magnetic sensor for a precise indoor localization system of an autonomous vehicle , 2016, 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[103]  Guanghui Li,et al.  An efficient improved artificial potential field based regression search method for robot path planning , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[104]  Gerhard P. Hancke,et al.  Practical challenges of IR-UWB based ranging in harsh industrial environments , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[105]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[106]  K. Khoshelhama,et al.  A COMPARISON OF BAYESIAN AND EVIDENCE-BASED FUSION METHODS FOR AUTOMATED BUILDING DETECTION IN AERIAL DATA , 2008 .

[107]  Gerhard P. Hancke,et al.  Experimental Link Quality Characterization of Wireless Sensor Networks for Underground Monitoring , 2015, IEEE Transactions on Industrial Informatics.

[108]  Ala I. Al-Fuqaha,et al.  An intelligent data fusion technique based on the particle filter to perform precise outdoor localization , 2013, Int. J. Pervasive Comput. Commun..

[109]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[110]  Shang-Hong Lai,et al.  A consensus sampling technique for fast and robust model fitting , 2009, Pattern Recognit..

[111]  Jin Bae Park,et al.  Analysis of mobile robot navigation using vector field histogram according to the number of sectors, the robot speed and the width of the path , 2014, 2014 14th International Conference on Control, Automation and Systems (ICCAS 2014).

[112]  Tianmiao Wang,et al.  Monocular vision and IMU based navigation for a small unmanned helicopter , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[113]  Pieter Jonker,et al.  Real-time computer vision system for mobile robot , 2001, SPIE Optics East.

[114]  S. Soleimanpour,et al.  Sensor fusion in Robot localization using DS-Evidence Theory with conflict detection using Mahalanobis distance , 2008, 2008 7th IEEE International Conference on Cybernetic Intelligent Systems.

[115]  Gerhard P. Hancke,et al.  Security Challenges for User-Oriented RFID Applications within the "Internet of Things" , 2010 .

[116]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[117]  W. Burgard,et al.  Markov Localization for Mobile Robots in Dynamic Environments , 1999, J. Artif. Intell. Res..

[118]  Jun Zhang,et al.  Monocular robot navigation using invariant natural features , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[119]  Earl T. Benser,et al.  Trends in inertial sensors and applications , 2015, 2015 IEEE International Symposium on Inertial Sensors and Systems (ISISS) Proceedings.

[120]  D. Parhi,et al.  Navigational control of underwater mobile robot using dynamic differential evolution approach , 2017 .

[121]  Gaurav S. Sukhatme,et al.  Robust localization using relative and absolute position estimates , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[122]  A. Mahmood,et al.  Real time localization of mobile robotic platform via fusion of Inertial and Visual Navigation System , 2012, 2012 International Conference of Robotics and Artificial Intelligence.

[123]  Vincent Lepetit,et al.  Combining Geometric and Appearance Priors for Robust Homography Estimation , 2010, ECCV.

[124]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[125]  Javier Ruiz-del-Solar,et al.  Object recognition using local invariant features for robotic applications: A survey , 2016, Pattern Recognit..

[126]  Roberto Sabatini,et al.  Particle filter based multi-sensor data fusion techniques for RPAS navigation and guidance , 2015, 2015 IEEE Metrology for Aerospace (MetroAeroSpace).

[127]  Tao Zhang,et al.  A new hybrid navigation algorithm for mobile robots in environments with incomplete knowledge , 2012, Knowl. Based Syst..

[128]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[129]  Jeff Bird,et al.  Indoor navigation with foot-mounted strapdown inertial navigation and magnetic sensors [Emerging Opportunities for Localization and Tracking] , 2011, IEEE Wireless Communications.

[130]  Yingmin Jia,et al.  Indoor localization for mobile robots using lampshade corners as landmarks: Visual system calibration, feature extraction and experiments , 2014 .

[131]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[132]  Juan Li,et al.  A novel system for object pose estimation using fused vision and inertial data , 2017, Inf. Fusion.

[133]  Javeria Farooq Object detection and identification using SURF and BoW model , 2016, 2016 International Conference on Computing, Electronic and Electrical Engineering (ICE Cube).

[134]  Yaadhav Raaj,et al.  3D Object Localization using Forward Looking Sonar (FLS) and Optical Camera via particle filter based calibration and fusion , 2016, OCEANS 2016 MTS/IEEE Monterey.

[135]  Du Xin,et al.  Neural network and genetic algorithm based global path planning in a static environment , 2005 .

[136]  Xiuhua Li,et al.  Survey on Camera Calibration Technique , 2013, 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics.