Obstacle detection in single images with deep neural networks

Obstacle detection in single images is a challenging problem in autonomous navigation on low-cost condition. In this paper, we introduce an approach for obstacle detection in single images with deep neural networks. We propose the followings: (1) a deep model combined with other deep neural network for obstacle detection; (2) a method to segment obstacles and infer their depths. Among others, both local and global information are generated in our method for better classification and portability. Experiments are performed on the open datasets and images captured by our autonomous vehicle. The results show that our method is effective in both obstacle detection and depth inference.

[1]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[2]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Xiaonan Luo,et al.  Real-time background subtraction-based video surveillance of people by integrating local texture patterns , 2014, Signal Image Video Process..

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[6]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[7]  Stefan Roth,et al.  Efficient Multi-cue Scene Segmentation , 2013, GCPR.

[8]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[10]  Wilfried Enkelmann,et al.  Obstacle detection by evaluation of optical flow fields from image sequences , 1990, Image Vis. Comput..

[11]  Rui Liu,et al.  Real-time obstacle detection with motion features using monocular vision , 2014, The Visual Computer.

[12]  R. Kennedy,et al.  Defense Advanced Research Projects Agency (DARPA). Change 1 , 1996 .

[13]  Matthew Turk,et al.  Color Road Segmentation And Video Obstacle Detection , 1987, Other Conferences.

[14]  Illah R. Nourbakhsh,et al.  Appearance-Based Obstacle Detection with Monocular Color Vision , 2000, AAAI/IAAI.

[15]  Marc'Aurelio Ranzato,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2006, NIPS.

[16]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[17]  Gaurav S. Sukhatme,et al.  Real-time Motion Tracking from a Mobile Robot , 2010, Int. J. Soc. Robotics.

[18]  Derek C. Schuurman,et al.  Vision-based obstacle detection using a support vector machine , 2009, 2009 Canadian Conference on Electrical and Computer Engineering.

[19]  Christian Goerick,et al.  Artificial neural networks in real-time car detection and tracking applications , 1996, Pattern Recognit. Lett..

[20]  C. Laugier,et al.  Real-time moving obstacle detection using optical flow models , 2006, 2006 IEEE Intelligent Vehicles Symposium.