Fisheye image rectification for efficient large-scale stereo

Stereo vision using fisheye lenses has received greater attention in recent years due to its vast number of applications. As an essential prerequisite for stereo processing, this work proposes a fisheye image rectification method for efficient large-scale stereo. The scene distance was formulated within the spherical model. Reprojecting the original images using transverse Mercator projection enabled us to proof a theorem for which distance computing could be simplified to only a division operation of a constant and the disparity. Experimental results shows that stereo processing using this method could achieve much faster computational speed than existing approaches while maintaining satisfying matching quality.

[1]  Marc Pollefeys,et al.  Real-Time Direct Dense Matching on Fisheye Images Using Plane-Sweeping Stereo , 2014, 2014 2nd International Conference on 3D Vision.

[2]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Shigang Li Real-Time Spherical Stereo , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  H. Bakstein,et al.  Panoramic mosaicing with a 180/spl deg/ field of view lens , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[5]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Dongxiao Li,et al.  Full-Image Guided Filtering for Fast Stereo Matching , 2013, IEEE Signal Processing Letters.

[7]  Hans-Peter Seidel,et al.  Accurate Real-Time Disparity Estimation with Variational Methods , 2009, ISVC.

[8]  Dominique Gruyer,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005, Auton. Robots.

[9]  T. Nishimoto,et al.  Three dimensional measurement using fisheye stereo vision , 2007, SICE Annual Conference 2007.

[10]  Ulrich Amsel,et al.  The History of the Photographic Lens , 1922, Nature.

[11]  Gangolf Hirtz,et al.  Trinocular Spherical Stereo Vision for Indoor Surveillance , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[12]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[13]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  HirschmullerHeiko Stereo Processing by Semiglobal Matching and Mutual Information , 2008 .

[15]  Stefano Mattoccia,et al.  Linear stereo matching , 2011, 2011 International Conference on Computer Vision.

[16]  Emanuele Trucco,et al.  A compact algorithm for rectification of stereo pairs , 2000, Machine Vision and Applications.

[17]  Marc Pollefeys,et al.  Motion Estimation for Self-Driving Cars with a Generalized Camera , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Peter Osborne,et al.  The Mercator Projections , 2013 .

[19]  Shigang Li,et al.  Spherical stereo for the construction of immersive VR environment , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[20]  Qingxiong Yang,et al.  A non-local cost aggregation method for stereo matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Xianghua Ying,et al.  Can We Consider Central Catadioptric Cameras and Fisheye Cameras within a Unified Imaging Model , 2004, ECCV.

[22]  Shigang Li,et al.  Binocular Spherical Stereo , 2008, IEEE Transactions on Intelligent Transportation Systems.

[23]  Jake K. Aggarwal,et al.  Depth estimation using stereo fish-eye lenses , 1994, Proceedings of 1st International Conference on Image Processing.

[24]  Wolfgang Förstner,et al.  Fish-Eye-Stereo Calibration and Epipolar Rectification , 2005 .

[25]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Seth J. Teller,et al.  Spherical Mosaics with Quaternions and Dense Correlation , 2000, International Journal of Computer Vision.