A Novel Mobile Robot Navigation Method Based on Hand-Drawn Paths

In the real world, a human tourist can quickly arrive at a target along the route planned by his/her instinctive cognition of prepared maps. While on the mobile robot, it is required to know every way-points of the static or dynamic planning paths to reach a goal point. The previous navigation modes are mostly from sensor location, speech interaction, grid maps and so on. They rely on sensing performance, the speech instruction of site personnel or complex algorithms for the path searching and tracking. For improving the performance of interaction and tele-operated path tracking, in this paper, a novel interactive navigation based on the recognition of hand-drawn paths is proposed for mobile robots. Pen, paper, and camera are employed as the interface between users and the mobile robot. Initially, the image of a hand drawn path in the paper map is captured by a camera and segmented from the background by the color detection model. It is hypothesized that the captured frame of hand-drawn paths is slant to the original orthogonal map. Therefore, this method should firstly project the smoothed skeleton of slant path into the coordinate space of orthogonal map to guide the robot to perform path tracking. Then the hand-drawn path is rectified and remapped into the registered reference image of the orthogonal map through feature matching and perspective transformation. The combination of SIFT and RANSAC algorithms are employed for improving the accuracy of the projection of slant paths in the orthogonal map. Sequentially, a limited number of way-points are picked out from the corrected path in an orthogonal 2D map space usable for 2D navigation. The oriented sequential motion vectors are estimated by linking all successive way-points and employed for the path tracking along the predefined route step by step. Eventually, random navigation paths are designed to validate the robustness, effectiveness and accuracy of the constructed interactive navigation system.

[1]  Achim J. Lilienthal,et al.  Using sketch-maps for robot navigation: Interpretation and matching , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[2]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[3]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[4]  Roger Skjetne,et al.  A Multibeam-Based SLAM Algorithm for Iceberg Mapping Using AUVs , 2018, IEEE Access.

[5]  Aly A. Farag,et al.  PDE-based robust robotic navigation , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  J. Little,et al.  Inverse perspective mapping simplifies optical flow computation and obstacle detection , 2004, Biological Cybernetics.

[9]  Zhenmin Tang,et al.  Speech Enhancement Based on NMF Under Electric Vehicle Noise Condition , 2018, IEEE Access.

[10]  Matthew R. Walter,et al.  Learning Semantic Maps from Natural Language Descriptions , 2013, Robotics: Science and Systems.

[11]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[12]  Günter Rote,et al.  Computing the Minimum Hausdorff Distance Between Two Point Sets on a Line Under Translation , 1991, Inf. Process. Lett..

[13]  Yan-Jun Liu,et al.  ADP-Based Online Tracking Control of Partially Uncertain Time-Delayed Nonlinear System and Application to Wheeled Mobile Robots , 2020, IEEE Transactions on Cybernetics.

[14]  Hyun Chul Roh,et al.  Accurate Mobile Urban Mapping via Digital Map-Based SLAM , 2016, Sensors.

[15]  Juan Humberto Sossa Azuela,et al.  Automatic path planning for a mobile robot among obstacles of arbitrary shape , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Jee-Hwan Ryu,et al.  Development of the human interactive autonomy for the shared teleoperation of mobile robots , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Suk-Kyo Hong,et al.  A roadmap construction algorithm for mobile robot path planning using skeleton maps , 2007, Adv. Robotics.

[18]  Younes Akbari,et al.  A novel database for automatic processing of Persian handwritten bank checks , 2018, Pattern Recognit..

[19]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[20]  Yan-Jun Liu,et al.  Adaptive Neural Network-Based Tracking Control for Full-State Constrained Wheeled Mobile Robotic System , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  Rabia Jafri,et al.  Visual and Infrared Sensor Data-Based Obstacle Detection for the Visually Impaired Using the Google Project Tango Tablet Development Kit and the Unity Engine , 2018, IEEE Access.

[22]  Rui Yang,et al.  Emergency-Oriented Spatiotemporal Trajectory Pattern Recognition by Intelligent Sensor Devices , 2017, IEEE Access.

[23]  Chunheng Wang,et al.  Degraded document image binarization using structural symmetry of strokes , 2018, Pattern Recognit..

[24]  Wolfram Burgard,et al.  Autonomous indoor robot navigation using a sketch interface for drawing maps and routes , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Francisco Rodríguez,et al.  An interactive tool for mobile robot motion planning , 2008, Robotics Auton. Syst..

[26]  Matthew R. Walter,et al.  Learning spatial-semantic representations from natural language descriptions and scene classifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[27]  David Filliat,et al.  Map-based navigation in mobile robots: II. A review of map-learning and path-planning strategies , 2003, Cognitive Systems Research.

[28]  Etienne Colle,et al.  A multihypothesis set approach for mobile robot localization using heterogeneous measurements provided by the Internet of Things , 2017, Robotics Auton. Syst..

[29]  Atef Hamouda,et al.  A New Path Generation Algorithm Based on Accurate NURBS Curves , 2016 .

[30]  Weiran Yao,et al.  Online Trajectory Generation with Rendezvous for UAVs Using Multistage Path Prediction , 2017 .

[31]  Ivan Kuric,et al.  Development of simulation software for mobile robot path planning within multilayer map system based on metric and topological maps , 2017 .

[32]  Fernando Auat Cheein,et al.  Overcoming the Loss of Performance in Unmanned Ground Vehicles Due to the Terrain Variability , 2018, IEEE Access.

[33]  Jianqiang Yi,et al.  Extracting the trajectory of writing brush in Chinese character calligraphy , 2004, Eng. Appl. Artif. Intell..

[34]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[35]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[36]  Marjorie Skubic,et al.  A sketch interface for mobile robots , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[37]  Zongquan Deng,et al.  Adaptive Neural Network-Based Finite-Time Online Optimal Tracking Control of the Nonlinear System With Dead Zone , 2019, IEEE Transactions on Cybernetics.

[38]  Lei Liu,et al.  A collision-free motion planning method by integrating complexity-reduction SLAM and learning-based artificial force design , 2018, Robotics Auton. Syst..

[39]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[40]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[41]  Shiyin Qin,et al.  A Fast Algorithm of Simultaneous Localization and Mapping for Mobile Robot Based on Ball Particle Filter , 2018, IEEE Access.

[42]  Mark E. Campbell,et al.  A Sketch Interface for Robust and Natural Robot Control , 2012, Proceedings of the IEEE.

[43]  Mark E. Campbell,et al.  A qualitative path planner for robot navigation using human-provided maps , 2013, Int. J. Robotics Res..

[44]  Pankoo Kim,et al.  A Green Ant-Based method for Path Planning of Unmanned Ground Vehicles , 2017, IEEE Access.

[45]  Zhixiong Li,et al.  Image Sequence Matching Using Both Holistic and Local Features for Loop Closure Detection , 2017, IEEE Access.

[46]  Larry H. Matthies,et al.  Autonomous Navigation Results from the Mars Exploration Rover (MER) Mission , 2004, ISER.

[47]  A. Bandera,et al.  Hierarchical planning in a mobile robot for map learning and navigation , 2003 .

[48]  Dongbing Gu,et al.  Extracting Semantic Information from Visual Data: A Survey , 2016, Robotics.

[49]  Luca Maria Gambardella,et al.  zePPeLIN: Distributed Path Planning Using an Overhead Camera Network , 2014 .

[50]  Diaz de Leon S Jl,et al.  Automatic path planning for a mobile robot among obstacles of arbitrary shape. , 1998 .

[51]  Jean-Arcady Meyer,et al.  Map-based navigation in mobile robots: I. A review of localization strategies , 2003, Cognitive Systems Research.

[52]  Liang Ding,et al.  Human robot interaction for manipulation tasks based on stroke gesture recognition , 2017, Ind. Robot.

[53]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[54]  Jianliang Xu,et al.  An Ontology-Based Approach for Marine Geochemical Data Interoperation , 2017, IEEE Access.

[55]  Aura Ganz,et al.  Indoor Navigation Validation Framework for Visually Impaired Users , 2017, IEEE Access.

[56]  José del R. Millán,et al.  Efficient learning of variable-resolution cognitive maps for autonomous indoor navigation , 1999, IEEE Trans. Robotics Autom..