SVM-based image partitioning for vision recognition of AGV guide paths under complex illumination conditions

Abstract Applying computer vision to mobile robot navigation has been studied more than two decades. For the commercial off-the-shelf (COTS) automated guided vehicles (AGV) products, the cameras are still not widely used for the acquisition of guidance information from the environment. One of the most challenging problems for a vision guidance system of AGVs lies in the complex illumination conditions. Compared to the applications of computer vision where on-machine cameras are fixed in place, it is difficult to structure the illumination circumstance for an AGV that needs to travel through a large work space. In order to distinguish the original color features of path images from their illumination artifacts, an illumination-adaptive image partitioning approach is proposed based on the support vector machine (SVM) classifier with the slack constraint and the kernel function, which is utilized to divide a path image to low-, normal-, and high-illumination regions automatically. Moreover, an intelligent path recognition method is developed to carry out guide color enhancement and adaptive threshold segmentation in different regions. Experimental results show that the SVM-based classifier has the satisfactory generalization ability, and the illumination-adaptive path recognition approach has the high adaptability to the complex illumination conditions, when recognizing the path pixels in the field of view with both high-reflective and dark-shadow regions. The 98% average rate of path recognition will significantly facilitate the subsequent operation of path fitting for vision guidance of AGVs.

[1]  D. Herrero-Pérez,et al.  Autonomous navigation of an automated guided vehicle in industrial environments , 2010 .

[2]  Sergiu Nedevschi,et al.  Development of an omnidirectional stereo vision system , 2013, 2013 IEEE 9th International Conference on Intelligent Computer Communication and Processing (ICCP).

[3]  Romuald Aufrère,et al.  Real-Time Monocular SLAM With Low Memory Requirements , 2015, IEEE Transactions on Intelligent Transportation Systems.

[4]  Vitor Santos,et al.  Object recognition and pose estimation for industrial applications: A cascade system , 2014 .

[5]  Chenglin Wen,et al.  An Online-Updating Deep CNN Method Based on Kalman Filter for Illumination-Drifting Road Damage Classification , 2018, 2018 International Conference on Control, Automation and Information Sciences (ICCAIS).

[6]  Gerald Steinbauer,et al.  Dynamic Arc Fitting Path Follower for Skid-Steered Mobile Robots , 2015 .

[7]  Zhao Long,et al.  Coordinated path tracking of two vision-guided tractors for heavy-duty robotic vehicles , 2018, Robotics and Computer-Integrated Manufacturing.

[8]  Alonzo Kelly,et al.  Field and service applications - An infrastructure-free automated guided vehicle based on computer vision - An Effort to Make an Industrial Robot Vehicle that Can Operate without Supporting Infrastructure , 2007, IEEE Robotics & Automation Magazine.

[9]  D. Herrero-Pérez,et al.  An Accurate and Robust Flexible Guidance System for Indoor Industrial Environments , 2013 .

[10]  Eric T. Baumgartner,et al.  An autonomous vision-based mobile robot , 1994, IEEE Trans. Autom. Control..

[11]  Xiangjun Wang,et al.  Improved illumination for vision-based defect inspection of highly reflective metal surface , 2013 .

[12]  A. Paulo Moreira,et al.  Object recognition using laser range finder and machine learning techniques , 2013 .

[13]  Álvaro Enrique Arenas,et al.  Position verification of a mobile robot using standard pattern , 1987, IEEE Journal on Robotics and Automation.

[14]  Yongfeng Ju,et al.  Online Road Detection under a Shadowy Traffic Image Using a Learning-Based Illumination-Independent Image , 2018, Symmetry.

[15]  Mignon Park,et al.  A Vision-Based Automated Guided Vehicle System with Marker Recognition for Indoor Use , 2013, Sensors.

[16]  Shiming Xiang,et al.  Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Chengyang Li,et al.  Illumination-aware Faster R-CNN for Robust Multispectral Pedestrian Detection , 2018, Pattern Recognit..

[18]  John Y. Chiang,et al.  Vision-based Assembly and Inspection System for Golf Club Heads , 2015 .

[19]  Chiunhsiun Lin,et al.  Face detection in complicated backgrounds and different illumination conditions by using YCbCr color space and neural network , 2007, Pattern Recognit. Lett..

[20]  Se-Young Oh,et al.  Illumination invariant lane color recognition by using road color reference & neural networks , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[21]  De Xu,et al.  Ceiling-Based Visual Positioning for an Indoor Mobile Robot With Monocular Vision , 2009, IEEE Transactions on Industrial Electronics.

[22]  Jonathan Paxman,et al.  Vision based localization under dynamic illumination , 2011, The 5th International Conference on Automation, Robotics and Applications.

[23]  Gunther Reinhart,et al.  Identification of Influence Parameters and Dependencies on the Illumination of Machine Vision Systems for Robots , 2016 .

[24]  Bin Yang,et al.  A Deep Reconstruction CNN for Illumination-robust Face Image Recovery and Recognition , 2018, 2018 IEEE 17th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[25]  Raffaello D'Andrea,et al.  Guest editorial: A revolution in the warehouse: a retrospective on Kiva Systems and the grand challenges ahead , 2012, IEEE Trans Autom. Sci. Eng..

[26]  Kwanghoon Sohn,et al.  Automatic illumination invariant road detection with stereo vision , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[27]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[28]  Javier Ibanez Guzman,et al.  A constrained SLAM approach to robust and accurate localisation of autonomous ground vehicles , 2007, Robotics Auton. Syst..

[29]  Bojan Babić,et al.  New hybrid vision-based control approach for automated guided vehicles , 2013 .

[30]  Kiyoshi Irie,et al.  Outdoor Localization Using Stereo Vision Under Various Illumination Conditions , 2012, Adv. Robotics.

[31]  Arthur Daniel Costea,et al.  Modeling and tracking of dynamic obstacles for logistic plants using omnidirectional stereo vision , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[32]  Hesheng Wang,et al.  Automatic illumination planning for robot vision inspection system , 2018, Neurocomputing.

[33]  Wu Xing,et al.  Intersection Recognition and Guide-Path Selection for a Vision-Based AGV in a Bidirectional Flow Network , 2014 .

[34]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Jun Ota,et al.  Automated Field-of-View, Illumination, and Recognition Algorithm Design of a Vision System for Pick-and-Place Considering Colour Information in Illumination and Images , 2018, Sensors.

[36]  Wu Jun,et al.  Combining CNN and MRF for Road Detection , 2017 .

[37]  Hsien-I Lin,et al.  Development of an intelligent transformer insertion system using a robot arm , 2018, Robotics and Computer-Integrated Manufacturing.

[38]  Dexing Zhong,et al.  A Bevel Gear Quality Inspection System Based on Multi-Camera Vision Technology , 2016, Sensors.

[39]  Sergiu Nedevschi,et al.  Omnidirectional stereo vision using fisheye lenses , 2014, 2014 IEEE 10th International Conference on Intelligent Computer Communication and Processing (ICCP).

[40]  Zdenko Kovacic,et al.  High-accuracy vehicle localization for autonomous warehousing , 2016 .