An online probabilistic road intersection detector

In this paper we propose a probabilistic approach for detecting and classifying urban road intersections from a moving vehicle. The approach is based on images from an onboard stereo rig; it relies on the detection of the road ground plane on one side, and on a pixel-level classification of the road on the other. The two processing pipelines are then integrated and the parameters of the road components, i.e., the intersection geometry, are inferred. As opposed to other state-of-the-art offline methods, which require processing of the whole video sequence, our approach integrates the image data by means of an online procedure. The experiments have been performed on well-known KITTI datasets, allowing for future comparisons.

[1]  Mohamed Essayed Bouzouraa,et al.  In-vehicle Roundabout Perception Supported by A Priori Map Data , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[2]  Bastian Leibe,et al.  OpenStreetSLAM: Global vehicle localization using OpenStreetMaps , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Antonio Criminisi,et al.  TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation , 2006, ECCV.

[4]  Augusto Luis Ballardini,et al.  Leveraging the OSM building data to enhance the localization of an urban vehicle , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[5]  Kok Kiong Tan,et al.  Comprehensive and Practical Vision System for Self-Driving Vehicle Lane-Level Localization , 2016, IEEE Transactions on Image Processing.

[6]  Andreas Geiger,et al.  Probabilistic Models for 3D Urban Scene Understanding from Movable Platforms , 2013 .

[7]  J. Geisler,et al.  ROMA - a system for model-based analysis of road markings , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[8]  Yann LeCun,et al.  Road Scene Segmentation from a Single Image , 2012, ECCV.

[9]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[10]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Danfei Xu,et al.  Topometric localization on a road network , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  David Fernández Llorca,et al.  A Comparative Analysis of Decision Trees Based Classifiers for Road Detection in Urban Environments , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[13]  Michael R. James,et al.  Joint probabilistic modeling and inference of intersection structure , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[14]  Frank P. Ferrie,et al.  Window detection from mobile LiDAR data , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[15]  David Fernández Llorca,et al.  Curvature-based curb detection method in urban environments using stereo and laser , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[16]  Theo Gevers,et al.  Combining Priors, Appearance, and Context for Road Detection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[17]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[18]  Theo Gevers,et al.  3D Scene priors for road detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Todd R. Kushner,et al.  Progress In Road Intersection Detection For Autonomous Vehicle Navigation , 1987, Other Conferences.

[20]  Michel Dhome,et al.  Vision-Based Differential GPS: Improving VSLAM / GPS Fusion in Urban Environment with 3D Building Models , 2014, 2014 2nd International Conference on 3D Vision.

[21]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[22]  Martin Lauer,et al.  3D Traffic Scene Understanding From Movable Platforms , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Bastian Leibe,et al.  Joint 2D-3D temporally consistent semantic segmentation of street scenes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Charles E. Thorpe,et al.  SCARF: a color vision system that tracks roads and intersections , 1993, IEEE Trans. Robotics Autom..

[25]  Ignacio Parra,et al.  Accurate Global Localization Using Visual Odometry and Digital Maps on Urban Environments , 2012, IEEE Transactions on Intelligent Transportation Systems.

[26]  Christopher Rasmussen,et al.  Road shape classification for detecting and negotiating intersections , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[27]  Ignacio Parra,et al.  Visual odometry and map fusion for GPS navigation assistance , 2011, 2011 IEEE International Symposium on Industrial Electronics.

[28]  Theo Gevers,et al.  Road Geometry Classification by Adaptive Shape Models , 2013, IEEE Transactions on Intelligent Transportation Systems.

[29]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Luc Van Gool,et al.  3D Urban Scene Modeling Integrating Recognition and Reconstruction , 2008, International Journal of Computer Vision.

[31]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[32]  Patrick Pérez,et al.  Incremental dense semantic stereo fusion for large-scale semantic scene reconstruction , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Mohamed Essayed Bouzouraa,et al.  Circle detection in single-layer laser scans for roundabout perception , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[34]  Augusto Luis Ballardini,et al.  A Framework for Outdoor Urban Environment Estimation , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[35]  Emmanuel Seignez,et al.  Probabilistic error model for a lane marking based vehicle localization coupled to open source maps , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[36]  Martin Lauer,et al.  A generative model for 3D urban scene understanding from movable platforms , 2011, CVPR 2011.

[37]  Andreas Geiger,et al.  Understanding High-Level Semantics by Modeling Traffic Patterns , 2013, 2013 IEEE International Conference on Computer Vision.

[38]  Alexei A. Efros,et al.  Blocks World Revisited: Image Understanding Using Qualitative Geometry and Mechanics , 2010, ECCV.

[39]  Yoshua Bengio,et al.  ReNet: A Recurrent Neural Network Based Alternative to Convolutional Networks , 2015, ArXiv.

[40]  Ali Shahrokni,et al.  Urban 3D semantic modelling using stereo vision , 2013, 2013 IEEE International Conference on Robotics and Automation.

[41]  Nojun Kwak,et al.  Superpixel-based semantic segmentation trained by statistical process control , 2017, BMVC.

[42]  Florentin Smarandache,et al.  Advances and Applications of DSmT for Information Fusion (Collected Works) , 2004 .

[43]  Wolfram Burgard,et al.  Localization on OpenStreetMap data using a 3D laser scanner , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Luc Van Gool,et al.  Segmentation-Based Urban Traffic Scene Understanding , 2009, BMVC.

[45]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[46]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[47]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Alexei A. Efros,et al.  Closing the loop in scene interpretation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  H.-H. Nagel,et al.  Model-based recognition of intersections and lane structures , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.