A Novel Visual Lane Line Detection System for a NMPC-based Path Following Control Scheme

Tracking a visual path to perform image-based control requires additional processing to extract valuable information even in the presence of inconveniences, such as failures or deformation in the lane line or even restrictive environmental conditions. Dealing with faulty in the path to be followed, non-homogeneous floors and bad lighting condition are some of the difficulties encountered that compromise the accurate of feature extraction and consequently the controller effectiveness. In this paper, a novel visual system is proposed to detect and extract useful lane line parameters and to use them in a NMPC-based Visual Path Following Control Scheme. To cope with the above-mentioned problems, the visual path is approximated by a quadratic function and to robustness improve, this novel algorithm was modified to use RANSAC as a model estimation approach instead of using the classical Least Square Method. Experimental results demonstrate the superiority of the proposed system with respect to two others, in environments with visual disturbance, faulty paths, noise and bad lighting conditions.

[1]  Soon-Yong Park,et al.  Curved lane detection using robust feature extraction , 2014, The 2014 2nd International Conference on Systems and Informatics (ICSAI 2014).

[2]  Edwin Olson,et al.  Finding multiple lanes in urban road networks with vision and lidar , 2009, Auton. Robots.

[3]  André Scolari Conceição,et al.  NMPC-based Visual Leader-Follower Formation Control for Wheeled Mobile Robots , 2018, 2018 IEEE 16th International Conference on Industrial Informatics (INDIN).

[4]  Yen-Feng Li,et al.  Vision-based vehicle detection for a driver assistance system , 2011, Comput. Math. Appl..

[5]  Emmanuel Seignez,et al.  An Improved Approach for Vision-Based Lane Marking Detection and Tracking , 2013 .

[6]  Giancarmine Fasano,et al.  RGB-D camera-based quadrotor navigation in GPS-denied and low light environments using known 3D markers , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Azzedine Boukerche,et al.  A real-time lane marking localization, tracking and communication system , 2016, Comput. Commun..

[8]  André Scolari Conceição,et al.  Nonlinear Model Predictive Visual Path Following Control to Autonomous Mobile Robots , 2018, J. Intell. Robotic Syst..

[9]  Azzedine Boukerche,et al.  Lane detection and tracking system based on the MSER algorithm, hough transform and kalman filter , 2014, MSWiM '14.

[10]  R. Findeisen,et al.  Nonlinear Model Predictive Path-Following Control , 2009 .

[11]  Tiago T. Ribeiro,et al.  A Novel Approach for Parameter Extraction of an NMPC-based Visual Follower Model , 2019, 2019 19th International Conference on Advanced Robotics (ICAR).

[12]  Vladislav Bobkov,et al.  Automated control system of fabrics parameters that uses computer vision , 2018, 2018 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus).

[13]  Kok Kiong Tan,et al.  Vision-based lane line detection for autonomous vehicle navigation and guidance , 2015, 2015 10th Asian Control Conference (ASCC).

[14]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Hui Chen,et al.  Robust Lane Detection for Complicated Road Environment Based on Normal Map , 2018, IEEE Access.

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  Xiaobo Tan,et al.  Model Predictive Control-Based Path-Following for Tail-Actuated Robotic Fish , 2019, Journal of Dynamic Systems, Measurement, and Control.

[18]  William S. Levine,et al.  Handbook of Model Predictive Control , 2018, Control Engineering.

[19]  Shang-Jeng Tsai,et al.  HSI color model based lane-marking detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[20]  Hee-Woon Cheong,et al.  Concept Design of AGV (Automated Guided Vehicle) Based on Image Detection and Positioning , 2018, ITQM.

[21]  Megha P. Arakeri,et al.  Computer vision based robotic weed control system for precision agriculture , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[22]  Soon-Yong Park,et al.  Lane Marking Detection in Various Lighting Conditions using Robust Feature Extraction , 2014 .

[23]  Shoutao Li,et al.  Curve lane detection based on the binary particle swarm optimization , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[24]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.