VLDNet: Vision-based lane region detection network for intelligent vehicle system using semantic segmentation

Detection of lane region under the road boundary is an imperative module for intelligent vehicle system. Lane markings provide separate regions on the road for the vehicles to avoid the possibility of accidents. Existing methods in lane detection have limited performance using various sensor-based approaches such as Radar and LiDAR and have high operational costs. To achieve a steady and optimal lane detection, the vision-based lane region detection scheme VLDNet is proposed which utilizes a encoder-decoder network using semantic segmentation architecture. In this direction, a hybrid model using UNet and ResNet has been adopted, where UNet is used as a segmentation model and ResNet-50 is used for down-sampling the image and identifying the required features. These identified features have been then applied into UNet for up-sampling and decoding the segments of the images. The publicly available KITTI dataset have been accessed for experiments and validation of the proposed network. The method outperforms the existing state-of-the-art methods in lane region detection. The network achieves better performance using standard evaluation measures such as accuracy of 98.87%, the precision of 98.24%, recall of 96.55%, frequency weighted IoU of 97.78%, and MaxF score of 97.77%.

[1]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Lennart Svensson,et al.  Lidar-Camera Co-Training for Semi-Supervised Road Detection , 2019, ArXiv.

[3]  Hongdong Li,et al.  Semisupervised and Weakly Supervised Road Detection Based on Generative Adversarial Networks , 2018, IEEE Signal Processing Letters.

[4]  Zhe Chen,et al.  RBNet: A Deep Neural Network for Unified Road and Road Boundary Detection , 2017, ICONIP.

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Satya Prakash Sahu,et al.  Real Time Object Tracking for Intelligent Vehicle , 2020, 2020 First International Conference on Power, Control and Computing Technologies (ICPC2T).

[7]  Victor L. Knoop,et al.  Lane Determination With GPS Precise Point Positioning , 2017, IEEE Transactions on Intelligent Transportation Systems.

[8]  Mohsen Ghafoorian,et al.  EL-GAN: Embedding Loss Driven Generative Adversarial Networks for Lane Detection , 2018, ECCV Workshops.

[9]  Denis Fernando Wolf,et al.  Road terrain detection: Avoiding common obstacle detection assumptions using sensor fusion , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[10]  Jing Li,et al.  Robust multilane detection and tracking in urban scenarios based on LIDAR and mono-vision , 2014, IET Image Process..

[11]  Gabor Kiss Manchurian artificial intelligence in autonomous vehicles , 2020, J. Intell. Fuzzy Syst..

[12]  Martin Kunert,et al.  Lane Detection With a High-Resolution Automotive Radar by Introducing a New Type of Road Marking , 2019, IEEE Transactions on Intelligent Transportation Systems.

[13]  Bingbing Ni,et al.  Geometric Constrained Joint Lane Segmentation and Lane Boundary Detection , 2018, ECCV.

[14]  Lennart Svensson,et al.  LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks , 2018, Robotics Auton. Syst..

[15]  Dae-Hyun Kim Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors , 2020, Sensors.

[16]  Gerd Wanielik,et al.  Probabilistic road estimation and lane association using radar detections , 2011, 14th International Conference on Information Fusion.

[17]  Yang Yang Ye,et al.  Lane detection method based on lane structural analysis and CNNs , 2018 .

[18]  Jing Lou,et al.  A real-time road detection method based on reorganized lidar data , 2019, PloS one.

[19]  D. Powell,et al.  Land-vehicle navigation using GPS , 1999, Proc. IEEE.

[20]  Jian Yang,et al.  Lidar-histogram for fast road and obstacle detection , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Pablo Almorox-Gonzalez,et al.  Vehicular Traffic Surveillance and Road Lane Detection Using Radar Interferometry , 2012, IEEE Transactions on Vehicular Technology.

[22]  Liang Xiao,et al.  CRF based road detection with multi-sensor fusion , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[23]  Roberto Cipolla,et al.  MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving , 2016, 2018 IEEE Intelligent Vehicles Symposium (IV).

[24]  Chen Change Loy,et al.  Learning Lightweight Lane Detection CNNs by Self Attention Distillation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Satya Prakash Sahu,et al.  Driving Behavior Analysis of Intelligent Vehicle System for Lane Detection Using Vision-Sensor , 2021, IEEE Sensors Journal.

[27]  Satya Prakash Sahu,et al.  Automated Vehicle Parking Slot Detection System Using Deep Learning , 2020, 2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC).

[28]  Degui Xiao,et al.  Attention deep neural network for lane marking detection , 2020, Knowl. Based Syst..

[29]  Ethan Fetaya,et al.  Real-Time Category-Based and General Obstacle Detection for Autonomous Driving , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[30]  Yecheng Lyu,et al.  Road Segmentation using CNN and Distributed LSTM , 2018, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[31]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[32]  Jiyoung Jung,et al.  Real-Time Road Lane Detection in Urban Areas Using LiDAR Data , 2018, Electronics.

[33]  Jee-Young Sun,et al.  Reverse and Boundary Attention Network for Road Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[34]  Naim Dahnoun,et al.  Multiple Lane Detection Algorithm Based on Novel Dense Vanishing Point Estimation , 2017, IEEE Transactions on Intelligent Transportation Systems.

[35]  Satya Prakash Sahu,et al.  RCNet: road classification convolutional neural networks for intelligent vehicle system , 2021, Intelligent Service Robotics.

[36]  Feihu Zhang,et al.  Synthetic aperture radar for lane boundary detection in driver assistance systems , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[37]  Sergio L. Netto,et al.  A Survey on Performance Metrics for Object-Detection Algorithms , 2020, 2020 International Conference on Systems, Signals and Image Processing (IWSSIP).

[38]  Satya Prakash Sahu,et al.  Deep Learning-Based Speed Bump Detection Model for Intelligent Vehicle System Using Raspberry Pi , 2021, IEEE Sensors Journal.

[39]  S. Sahu,et al.  PotNet: Pothole detection for autonomous vehicle system using convolutional neural network , 2020 .

[40]  Luc Van Gool,et al.  End-to-end Lane Detection through Differentiable Least-Squares Fitting , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[41]  Wee Peng Tay,et al.  LaIF: A Lane-Level Self-Positioning Scheme for Vehicles in GNSS-Denied Environments , 2019, IEEE Transactions on Intelligent Transportation Systems.

[42]  Ying Wang,et al.  A lane detection network based on IBN and attention , 2019, Multimedia Tools and Applications.

[43]  Qibin Hou,et al.  SpinNet: Spinning convolutional network for lane boundary detection , 2019, Computational Visual Media.

[44]  Liang Xiao,et al.  Hybrid conditional random field based camera-LIDAR fusion for road detection , 2017, Inf. Sci..

[45]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[46]  Matthias Schulze,et al.  Reliable Multilane Detection and Classification by Utilizing CNN as a Regression Network , 2018, ECCV Workshops.

[47]  Long Chen,et al.  Robust Lane Detection From Continuous Driving Scenes Using Deep Neural Networks , 2019, IEEE Transactions on Vehicular Technology.

[48]  Wujie Zhou,et al.  Local and Global Feature Learning for Blind Quality Evaluation of Screen Content and Natural Scene Images , 2018, IEEE Transactions on Image Processing.

[49]  Zhu Xiao,et al.  Vision-Based Lane Detection and Lane-Marking Model Inference: A Three-Step Deep Learning Approach , 2018, 2018 9th International Symposium on Parallel Architectures, Algorithms and Programming (PAAP).

[50]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..