Dense 3D reconstruction using a rotational stereo camera

This paper proposes a method to construct a three-dimensional (3D) model of an outdoor scene containing a large amount of information by combining local stereo images which are acquired from multiway. It is difficult to reconstruct outdoor scenes accurately using a single view of a stereo camera because the distance to a target is very far compared with the stereo camera's baseline length. Therefore the proposed method models the uncertainty of a 3D point measured by the stereo camera. And this method makes the 3D model accurately by reducing the uncertainties of the 3D point from various angles to the region which includes the correct point. Multi-view stereo images are captured using a rotational stereo camera that swings back and forth and can capture not only the upper surface of an object but also the side surface of the object. As an experiment, a blimp robot with a rotational stereo camera is used to capture aerial stereo images of the ground. The proposed method achieves the accurate reconstruction of the outdoor 3D model using our method.

[1]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Derek Bradley,et al.  Accurate multi-view reconstruction using robust binocular stereo and surface meshing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Takashi Kohno,et al.  Hovering Control of Outdoor Blimp Robots Based on Path Following , 2011, J. Robotics Mechatronics.

[4]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  William H. Press,et al.  Numerical recipes in C , 2002 .

[6]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[9]  Thomas Malzbender,et al.  A Survey of Methods for Volumetric Scene Reconstruction from Photographs , 2001, VG.

[10]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Luc Van Gool,et al.  Combined Depth and Outlier Estimation in Multi-View Stereo , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Michael Goesele,et al.  Multi-View Stereo Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).