Making Bertha See

With the market introduction of the 2014 Mercedes-Benz S-Class vehicle equipped with a stereo camera system, autonomous driving has become a reality, at least in low speed highway scenarios. This raises hope for a fast evolution of autonomous driving that also extends to rural and urban traffic situations. In August 2013, an S-Class vehicle with close-to-production sensors drove completely autonomously for about 100 km from Mannheim to Pforzheim, Germany, following the well-known historic Bertha Benz Memorial Route. Next-generation stereo vision was the main sensing component and as such formed the basis for the indispensable comprehensive understanding of complex traffic situations, which are typical for narrow European villages. This successful experiment has proved both the maturity and the significance of machine vision for autonomous driving. This paper presents details of the employed vision algorithms for object recognition and tracking, free-space analysis, traffic light recognition, lane recognition, as well as self-localization.

[1]  Uwe Franke,et al.  Efficient representation of traffic scenes by means of dynamic stixels , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[2]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[3]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision: A New Breed of Technical Beings? , 1998, Artif. Intell..

[4]  Dariu Gavrila,et al.  The Issues , 2011 .

[5]  Markus Enzweiler,et al.  Efficient Stixel-based object recognition , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[6]  Dariu Gavrila,et al.  A Multilevel Mixture-of-Experts Framework for Pedestrian Classification , 2011, IEEE Transactions on Image Processing.

[7]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[8]  Uwe Franke,et al.  Towards a Global Optimal Multi-Layer Stixel Representation of Dense 3D Data , 2011, BMVC.

[9]  B. Schiele,et al.  Multi-cue onboard pedestrian detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Markus Enzweiler,et al.  Towards multi-cue urban curb recognition , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[11]  Uwe Franke,et al.  Recognition of bus stops through computer vision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[12]  Stefan K. Gehrig,et al.  A Real-Time Low-Power Stereo Vision Engine Using Semi-Global Matching , 2009, ICVS.

[13]  F. Lindner,et al.  Robust recognition of traffic signals , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[14]  Todd Jochem,et al.  Life in the Fast Lane: The Evolution of an Adaptive Vehicle Control System , 1996, AI Mag..

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Dariu Gavrila,et al.  Multi-cue pedestrian classification with partial occlusion handling , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Ernst D. Dickmanns,et al.  An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles , 1990, IEEE Trans. Syst. Man Cybern..

[18]  Julius Ziegler,et al.  Urban localization with camera and inertial measurement unit , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[19]  Uwe Franke,et al.  Stixmentation - Probabilistic Stixel based Traffic Scene Labeling , 2012, BMVC.

[20]  Christian Wöhler,et al.  An adaptable time-delay neural-network algorithm for image sequence analysis , 1999, IEEE Trans. Neural Networks.

[21]  Stefan K. Gehrig,et al.  An Evaluation Framework for Stereo-Based Driver Assistance , 2011, Theoretical Foundations of Computer Vision.

[22]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[23]  Christoph Stiller,et al.  Automated map generation from aerial images for precise vehicle localization , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.