Road Condition Estimation Based on Spatio-Temporal Reflection Models

Automated road condition estimation is a crucial basis for Advanced Driver Assistance Systems (ADAS) and even more for highly and fully automated driving functions in future. In order to improve vehicle safety relevant vehicle dynamics parameters, e.g. last-point-to-brake (LPB), last-point-to-steer (LPS), or vehicle curve speed should be adapted depending on the current weather-related road surface conditions. As vision-based systems are already integrated in many of today’s vehicles they constitute a beneficial resource for such a task. As a first contribution, we present a novel approach for reflection modeling which is a reliable and robust indicator for wet road surface conditions. We then extend our method by texture description features since local structures enable for the distinction of snow-covered and bare road surfaces. Based on a large real-life dataset we evaluate the performance of our approach and achieve results which clearly outperform other established vision-based methods while ensuring real-time capability.

[1]  Roger Johansson,et al.  Vision Zero – Implementing a policy for traffic safety , 2009 .

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[4]  Yuukou Horita,et al.  Distinction of Wet Road Surface Condition at Night Using Texture Features , 2014 .

[5]  Anirban Mondal,et al.  RoadEye: A System for Personalized Retrieval of Dynamic Road Conditions , 2014, 2014 IEEE 15th International Conference on Mobile Data Management.

[6]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[7]  Long Le,et al.  Road condition monitoring system based on a stereo camera , 2009, 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing.

[8]  Yuukou Horita,et al.  Detection of Road Surface Conditions in Winter using Road Surveillance Cameras at Daytime, Night-time and Twilight , 2014 .

[9]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[11]  Isao Horiba,et al.  Discrimination of the road condition toward understanding of vehicle driving environments , 2001, IEEE Trans. Intell. Transp. Syst..

[12]  Hideo Saito,et al.  Classification of Wet/Dry Area Based on the Mahalanobis Distance of Feature from Time Space Image Analysis , 2009, MVA.

[13]  Yuukou Horita,et al.  A method to distinguish road surface conditions for car-mounted camera images at night-time , 2012, 2012 12th International Conference on ITS Telecommunications.

[14]  Kebin Jia,et al.  Road Surface Condition Classification Based on Color and Texture Information , 2013, 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[15]  P. Eloranta,et al.  IoT for intelligent traffic system , 2013, 2013 IEEE 9th International Conference on Intelligent Computer Communication and Processing (ICCP).

[16]  Liping Fu,et al.  An automatic image recognition system for winter road surface condition classification , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[17]  Wilhelm Stork,et al.  Road surface classification for extended floating car data , 2014, 2014 IEEE International Conference on Vehicular Electronics and Safety.

[18]  Hunjun Yang,et al.  Classification Algorithm for Road Surface Condition , 2014 .

[19]  C. Asensio,et al.  On-board wet road surface identification using tyre/road noise and Support Vector Machines , 2014 .

[20]  Andres Huertas,et al.  Daytime Water Detection by Fusing Multiple Cues for Autonomous Off-Road Navigation , 2006 .

[21]  Joachim Denzler,et al.  Beyond thinking in common categories: Predicting obstacle vulnerability using large random codebooks , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[22]  Patrik Jonsson,et al.  Classification of road conditions: From camera images and weather data , 2011, 2011 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings.

[23]  C. Fosalau,et al.  Wet road surfaces detection by measuring the air humidity in two points , 2014, 2014 International Conference and Exposition on Electrical and Power Engineering (EPE).