Obstacle Avoidance Strategy for Mobile Robot Based on Monocular Camera

This research paper proposes a real-time obstacle avoidance strategy for mobile robots with a monocular camera. The approach uses a binary semantic segmentation FCN-VGG-16 to extract features from images captured by the monocular camera and estimate the position and distance of obstacles in the robot’s environment. Segmented images are used to create the frontal view of a mobile robot. Then, the optimized path planning based on the enhanced A* algorithm with a set of weighted factors, such as collision, path, and smooth cost improves the performance of a mobile robot’s path. In addition, a collision-free and smooth obstacle avoidance strategy will be devised by optimizing the cost functions. Lastly, the results of our evaluation show that the approach successfully detects and avoids static and dynamic obstacles in real time with high accuracy, efficiency, and smooth steering with low angle changes. Our approach offers a potential solution for obstacle avoidance in both global and local path planning, addressing the challenges of complex environments while minimizing the need for expensive and complicated sensor systems.

[1]  N. Bui,et al.  Multi-Scale Fully Convolutional Network-Based Semantic Segmentation for Mobile Robot Navigation , 2023, Electronics.

[2]  Weipeng Jing,et al.  Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning , 2023, Electronics.

[3]  M. Al-Khawaldeh,et al.  Obstacles Avoidance for Mobile Robot Using Type-2 Fuzzy Logic Controller , 2022, Robotics.

[4]  Z. Ibrahim,et al.  Convolutional Neural Network featuring VGG-16 Model for Glioma Classification , 2022, JOIV : International Journal on Informatics Visualization.

[5]  Qin Dong Path Planning Algorithm Based on Visual Image Feature Extraction for Mobile Robots , 2022, Mobile Information Systems.

[6]  Yan-ping Du,et al.  Image semantic segmentation with hierarchical feature fusion based on deep neural network , 2022, Connect. Sci..

[7]  S. Khodaygan,et al.  A continuous RRT*-based path planning method for non-holonomic mobile robots using B-spline curves , 2022, Journal of Ambient Intelligence and Humanized Computing.

[8]  R. Sitharthan,et al.  Scene terrain classification for autonomous vehicle navigation based on semantic segmentation method , 2021, Trans. Inst. Meas. Control.

[9]  Antonio J. Plaza,et al.  Image Segmentation Using Deep Learning: A Survey , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Manh Duong Phung,et al.  Game Theory-Based Optimal Cooperative Path Planning for Multiple UAVs , 2022, IEEE Access.

[11]  Xiangrong Xu,et al.  A Mobile Robot Path Planning Algorithm Based on Improved A* Algorithm and Dynamic Window Approach , 2022, IEEE Access.

[12]  Lioua Kolsi,et al.  Improved Dijkstra Algorithm for Mobile Robot Path Planning and Obstacle Avoidance , 2022, Computers, Materials & Continua.

[13]  N. Motoi,et al.  Local Path Planning: Dynamic Window Approach With Virtual Manipulators Considering Dynamic Obstacles , 2022, IEEE Access.

[14]  R. Chen,et al.  Vision-Aided Path Planning Using Low-Cost Gene Encoding for a Mobile Robot , 2022, Intelligent Automation & Soft Computing.

[15]  Wenming Wang,et al.  Smooth Path Planning of Mobile Robot Based on Improved Ant Colony Algorithm , 2021, J. Robotics.

[16]  Mohammad Samadi Gharajeh,et al.  An intelligent approach for autonomous mobile robots path planning based on adaptive neuro-fuzzy inference system , 2021 .

[17]  A Elfakharany,et al.  Investigation on the Effect of the Feature Extraction Backbone for Small Object Segmentation using Fully Convolutional Neural Network in Traffic Signs Application , 2021 .

[18]  Marin Orsic,et al.  Efficient semantic segmentation with pyramidal fusion , 2021, Pattern Recognit..

[19]  Jun Tian,et al.  Hybrid Path Planning Based on Safe A* Algorithm and Adaptive Window Approach for Mobile Robot in Large-Scale Dynamic Environment , 2020, J. Intell. Robotic Syst..

[20]  Yang Tang,et al.  Monocular depth estimation based on deep learning: An overview , 2020, Science China Technological Sciences.

[21]  Tamer Abukhalil,et al.  ROBOT NAVIGATION SYSTEM USING LASER AND A MONOCULAR CAMERA , 2020 .

[22]  Murat Lüy,et al.  Initial Results of Testing a Multilayer Laser Scanner in a Collision Avoidance System for Light Rail Vehicles , 2018 .

[23]  Meir Goldenberg,et al.  The Heuristic Search Research Framework , 2017, Knowl. Based Syst..

[24]  Jeffrey A. Fessler,et al.  On the Convergence Analysis of the Optimized Gradient Method , 2015, J. Optim. Theory Appl..

[25]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Guillermo Del Castillo,et al.  A sonar approach to obstacle detection for a vision-based autonomous wheelchair , 2006, Robotics Auton. Syst..