Thermal-infrared based drivable region detection

Drivable region detection is challenging since various types of road, occlusion or poor illumination condition have to be considered in a outdoor environment, particularly at night. In the past decade, Many efforts have been made to solve these problems, however, most of the already existing methods are designed for visible light cameras, which are inherently inefficient under low light conditions. In this paper, we present a drivable region detection algorithm designed for thermal-infrared cameras in order to overcome the aforementioned problems. The novelty of the proposed method lies in the utilization of on-line road initialization with a highly scene-adaptive sampling mask. Furthermore, our prior road information extraction is tailored to enforce temporal consistency among a series of images. In this paper, we also propose a large number of experiments in various scenarios (on-road, off-road and cluttered road). A total of about 6000 manually annotated images are made available in our website for the research community. Using this dataset, we compared our method against multiple state-of-the-art approaches including convolutional neural network (CNN) based methods to emphasize the robustness of our approach under challenging situations.

[1]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[2]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Yong Liu,et al.  Traversable region detection with a learning framework , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Kyandoghere Kyamakya,et al.  Non-intrusive car driver's emotion recognition using thermal camera , 2011, Proceedings of the Joint INDS'11 & ISTET'11.

[8]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[9]  Namil Kim,et al.  Multispectral pedestrian detection: Benchmark dataset and baseline , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  FuaPascal,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012 .

[11]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[12]  Seiichi Mita,et al.  Adaptive non-planar road detection and tracking in challenging environments using segmentation-based Markov Random Field , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Theo Gevers,et al.  Combining Priors, Appearance, and Context for Road Detection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[14]  Jae Shin Yoon,et al.  All-Day Visual Place Recognition : Benchmark Dataset and Baseline , 2015 .

[15]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[16]  Seiichi Mita,et al.  MRF-based road detection with unsupervised learning for autonomous driving in changing environments , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[17]  Keyu Lu,et al.  A hierarchical approach for road detection , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Mohamed A. Deriche,et al.  Scale-Space Properties of the Multiscale Morphological Dilation-Erosion , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Ondrej Miksik.  Rapid vanishing point estimation for general road detection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[20]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[21]  W. Sardha Wijesoma,et al.  Online, self-supervised vision-based terrain classification in unstructured environments , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[22]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Christopher Rasmussen,et al.  On-Vehicle and Aerial Texture Analysis for Vision-Based Desert Road Following , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  Mohan M. Trivedi,et al.  Multiperspective Thermal IR and Video Arrays for 3D Body Tracking and Driver Activity Analysis , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[25]  Qi Zhang,et al.  100+ Times Faster Weighted Median Filter (WMF) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[27]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.