Effective height-grid map building using inverse perspective image

This paper discusses an efficient method for generating height-grid maps, which are widely utilized in developing mobile robots and autonomous vehicles. The proposed method consists of four steps. First, inverse perspective images (IPI) are obtained from wide-angle cameras equipped with a fish-eye lens. Second, dense motion stereo is performed using IPI. Next, depth information is calculated and mapped onto the grid map. Lastly, a fusion of the grid maps is executed to enhance the quality of the map using a modified temporal median filter. The method can efficiently collect height and position information about objects relative to the road surface. The reason is that wide-angle images are converted to IPI to remove the perspective distortion of the road surface, and the depth is calculated using dense motion stereo from IPI. Moreover, the efficiency of the proposed fusion method is significantly higher than that of previous methods. The proposed method is very simple, but the quality that could be obtained is similar to the quality produced by the conventional technique, and the building speed showed dramatically fast performance of up to 200 fps in a single core CPU. In addition, we used a variety of test data and showed that the result verifies the validity of the proposed algorithm.

[1]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[2]  Eric Wahl,et al.  Stereo Fusion from Multiple Viewpoints , 2012, DAGM/OAGM Symposium.

[3]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[4]  Marc Pollefeys,et al.  Stereo depth map fusion for robot navigation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jeongdan Choi,et al.  Real‐Time Precision Vehicle Localization Using Numerical Maps , 2014 .

[6]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[7]  Ayoub Al-Hamadi,et al.  Stereo-Camera-Based Urban Environment Perception Using Occupancy Grid and Object Tracking , 2012, IEEE Transactions on Intelligent Transportation Systems.

[8]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  J. Yunde,et al.  Probabilistic depth map fusion for real-time multi-view stereo , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Andrea Fusiello,et al.  Quasi-Euclidean epipolar rectification of uncalibrated images , 2010, Machine Vision and Applications.

[11]  Eric Wahl,et al.  Parking assistance using dense motion-stereo , 2011, Machine Vision and Applications.

[12]  Wolfgang Förstner,et al.  Curb reconstruction using Conditional Random Fields , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[13]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[14]  Hujun Bao,et al.  Consistent Depth Maps Recovery from a Video Sequence , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jeng-Shyang Pan,et al.  Speed Up Temporal Median Filter for Background Subtraction , 2010, 2010 First International Conference on Pervasive Computing, Signal Processing and Applications.

[16]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Roland Siegwart,et al.  Infrastructure-based calibration of a multi-camera rig , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).