Multi-Scale Fully Convolutional Network-Based Semantic Segmentation for Mobile Robot Navigation

In computer vision and mobile robotics, autonomous navigation is crucial. It enables the robot to navigate its environment, which consists primarily of obstacles and moving objects. Robot navigation employing impediment detections, such as walls and pillars, is not only essential but also challenging due to real-world complications. This study provides a real-time solution to the problem of obtaining hallway scenes from an exclusive image. The authors predict a dense scene using a multi-scale fully convolutional network (FCN). The output is an image with pixel-by-pixel predictions that can be used for various navigation strategies. In addition, a method for comparing the computational cost and precision of various FCN architectures using VGG-16 is introduced. The binary semantic segmentation and optimal obstacle avoidance navigation of autonomous mobile robots are two areas in which our method outperforms the methods of competing works. The authors successfully apply perspective correction to the segmented image in order to construct the frontal view of the general area, which identifies the available moving area. The optimal obstacle avoidance strategy is comprised primarily of collision-free path planning, reasonable processing time, and smooth steering with low steering angle changes.

[1]  Xiangmin Chen,et al.  Research on the Classification of ECG and PCG Signals Based on BiLSTM-GoogLeNet-DS , 2022, Applied Sciences.

[2]  M. Al-Khawaldeh,et al.  Obstacles Avoidance for Mobile Robot Using Type-2 Fuzzy Logic Controller , 2022, Robotics.

[3]  Z. Ibrahim,et al.  Convolutional Neural Network featuring VGG-16 Model for Glioma Classification , 2022, JOIV : International Journal on Informatics Visualization.

[4]  Qin Dong Path Planning Algorithm Based on Visual Image Feature Extraction for Mobile Robots , 2022, Mobile Information Systems.

[5]  R. Sitharthan,et al.  Scene terrain classification for autonomous vehicle navigation based on semantic segmentation method , 2021, Trans. Inst. Meas. Control.

[6]  Antonio J. Plaza,et al.  Image Segmentation Using Deep Learning: A Survey , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Lioua Kolsi,et al.  Improved Dijkstra Algorithm for Mobile Robot Path Planning and Obstacle Avoidance , 2022, Computers, Materials & Continua.

[8]  J. Zerubia,et al.  Semantic Segmentation of Remote-Sensing Images Through Fully Convolutional Neural Networks and Hierarchical Probabilistic Graphical Models , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Leonard Rusli,et al.  Vision-based vanishing point detection of autonomous navigation of mobile robot for outdoor applications , 2021, Journal of Mechatronics, Electrical Power, and Vehicular Technology.

[10]  Yang Wang,et al.  Encoder- and Decoder-Based Networks Using Multiscale Feature Fusion and Nonlocal Block for Remote Sensing Image Semantic Segmentation , 2021, IEEE Geoscience and Remote Sensing Letters.

[11]  Marin Orsic,et al.  Efficient semantic segmentation with pyramidal fusion , 2021, Pattern Recognit..

[12]  Ki H. Chon,et al.  AR and ARMA model order selection for time-series modeling with ImageNet classification , 2021, Signal Processing.

[13]  Nguyen Truong Thinh,et al.  Real-Time Hybrid Navigation System-Based Path Planning and Obstacle Avoidance for Mobile Robots , 2020, Applied Sciences.

[14]  Dan Wang,et al.  HRED-Net: High-Resolution Encoder-Decoder Network for Fine-Grained Image Segmentation , 2020, IEEE Access.

[15]  Tamer Abukhalil,et al.  ROBOT NAVIGATION SYSTEM USING LASER AND A MONOCULAR CAMERA , 2020 .

[16]  Liang Li,et al.  Obstacle Avoidance Path Planning Design for Autonomous Driving Vehicles Based on an Improved Artificial Potential Field Algorithm , 2019, Energies.

[17]  Ronghua Shang,et al.  Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Angga Rusdinar,et al.  Lidar Application for Mapping and Robot Navigation on Closed Environment , 2018, Journal of Measurements, Electronics, Communications, and Systems.

[19]  Lianru Gao,et al.  Semantic Labeling of High Resolution Aerial Imagery and LiDAR Data with Fine Segmentation Network , 2018, Remote. Sens..

[20]  Murat Lüy,et al.  Initial Results of Testing a Multilayer Laser Scanner in a Collision Avoidance System for Light Rail Vehicles , 2018 .

[21]  Weiwei Sun,et al.  Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images Combined With DSM , 2018, IEEE Geoscience and Remote Sensing Letters.

[22]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[24]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[25]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.