Obstacle classification and detection for vision based navigation for autonomous driving

With the rising trend in research and development of autonomous vehicles, it is important to keep in mind the cost effectiveness of the system. The cost of high-end sensor technologies being astronomically expensive, the research opportunities are restricted to a select few of high-tech companies and research laboratories such as Google, Tesla, Ford, and the likes of it. Hence our main focus is to develop an autonomous system suitable for academic and research purposes as well. This can be achieved by using available sensors such as the monocular cameras. The existing computer vision techniques along with the deep learning tools like Convolutional Neural Network (CNN) can together be used for developing a robust vision based autonomous driving system. The proposed method uses the SegNet encoder-decoder architecture for pixel-wise semantic segmentation of the video frame followed by an obstacle detection algorithm. The entire algorithm was implemented and tested on a mobile embedded platform of NVIDIA's Jetson TK1.

[1]  Fernando A. Mujica,et al.  An Empirical Evaluation of Deep Learning on Highway Driving , 2015, ArXiv.

[2]  Massimo Bertozzi,et al.  Artificial vision in road vehicles , 2002, Proc. IEEE.

[3]  Jeffrey Ryan Lalonde Monocular Obstacle Detection for Moving Vehicles , 2011 .

[4]  P Jaya,et al.  Contour Based Object Tracking , 2014 .

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  James W. Davis,et al.  GESTURE RECOGNITION , 2023, International Research Journal of Modernization in Engineering Technology and Science.

[7]  Alain L. Kornhauser,et al.  Stereo Vision for Obstacle Detection in Autonomous Navigation , 2008 .

[8]  Chenyi Chen,et al.  Extracting Cognition out of Images for the Purpose of Autonomous Driving , 2016 .

[9]  Naveen Appiah,et al.  Obstacle detection using stereo vision for self-driving cars , 2015 .

[10]  Torsten Sattler,et al.  Obstacle detection for self-driving cars using only monocular cameras and wheel odometry , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  K. I. Ramachandran,et al.  An image processing based pedestrian detection system for driver assistance , 2016 .

[12]  Fredrik Gustafsson,et al.  Statistical Sensor Fusion , 2013 .

[13]  Sebastian Thrun,et al.  Practical object recognition in autonomous driving and beyond , 2011, Advanced Robotics and its Social Impacts.

[14]  Sebastian Thrun,et al.  Towards 3D object recognition via classification of arbitrary object tracks , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Bastian Leibe,et al.  Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).