Depth Map Regeneration via Improved Graph Cuts Using a Novel Omnidirectional Stereo Sensor

An integrated framework mainly focusing on stereo matching has been presented in this paper to obtain dense depth maps for a mobile robot that is equipped with a novel omnidirectional stereo vision sensor that is designed to obtain height information. The vision sensor is composed of a common perspective camera and two hyperbolic mirrors, which are separately fixed inside a glass cylinder. As the separation between the two mirrors provides much enlarged baseline, the precision of the system has improved correspondingly. Nevertheless, the large disparity space and image particularities that are different from general stereo vision system result in poor performance using common methods. To satisfy the reliability requirement by mobile robot navigation, we use improved graph cuts method, in which more appropriate three-variable smootheness model is proposed for general priors corresponding to more reasonable piecewise smoothness assumption since the well-known swap move algorithm can be applied to a wider class of functions. We also show the necessary modification to handle panoramic images, including deformed matching template, adaptable template scale. Experiment shows that this proposed vision system is feasible as a practical stereo sensor for accurate depth map generation.

[1]  Narendra Ahuja,et al.  Multiview panoramic cameras using mirror pyramids , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[3]  Olivier D. Faugeras,et al.  Computing differential properties of 3-D shapes from stereoscopic images without 3-D models , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  John B. Moore,et al.  Resolution invariant surfaces for panoramic vision systems , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Eduardo L. L. Cabral,et al.  Omnidirectional stereo vision with a hyperbolic double lobed mirror , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[9]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Feng Zhu,et al.  A Versatile Method for Omnidirectional Stereo Camera Calibration Based on BP Algorithm , 2006, ISNN.

[11]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Ben J. A. Kröse,et al.  Robust scene reconstruction from an omnidirectional vision system , 2003, IEEE Trans. Robotics Autom..

[14]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[15]  Yoshiaki Shirai,et al.  Recognizing Moving Obstacles for Robot Navigation using Real-time Omnidirectional Stereo Vision , 2002, J. Robotics Mechatronics.

[16]  Wolfgang Straßer,et al.  Omnidirectional 3D Modeling on a Mobile Robot using Graph Cuts , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  In So Kweon,et al.  Single Camera Catadioptric Stereo System , 2005, ICCV 2005.

[18]  Narendra Ahuja,et al.  An Omnidirectional Stereo Vision System Using a Single Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  W. Freeman,et al.  Generalized Belief Propagation , 2000, NIPS.

[20]  Radim Sára,et al.  Finding the Largest Unambiguous Component of Stereo Matching , 2002, ECCV.

[21]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[22]  Narendra Ahuja,et al.  Dense stereo matching using kernel maximum likelihood estimation , 2004, ICPR 2004.

[23]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.