Multi-camera 3D scene reconstruction from vanishing points

In this paper we present a multi-camera system, which serves as the primary vision apparatus for a ceiling based swinging service robotic platform. To facilitate a smooth and unimpeded movement of the swinging platform the knowledge of the working environment is essential. To this end we examine the 3D scene reconstruction by concurrent multiple views from the distinct cameras located at the upper corners of a room for volume calculation of objects in everyday indoor environments. The 3D scene reconstruction is used to determine the working volume where the swinging robot will be able to operate. At first, we detect lines across the views using the hough transformation while the computation of multiple vanishing points serves as the platform to distinguish regions across the multi camera system. We thereafter obtain correspondences across the multiple views of the test room and finally we determine the 3D volumes of objects across the scene. The preliminary experimental results show that the volume computation is very accurate and reasonably time consuming.

[1]  Olivier D. Faugeras,et al.  Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score , 2007, International Journal of Computer Vision.

[2]  Daniel Cremers,et al.  Continuous Global Optimization in Multiview 3D Reconstruction , 2007, EMMCVPR.

[3]  Ruzena Bajcsy,et al.  A Framework for Collaborative Real-Time 3D Teleimmersion in a Geographically Distributed Environment , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[4]  Jean-Philippe Pons,et al.  Efficient Multi-View Reconstruction of Large-Scale Scenes using Interest Points, Delaunay Triangulation and Graph Cuts , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Vladimir Kolmogorov,et al.  Multi-camera Scene Reconstruction via Graph Cuts , 2002, ECCV.

[7]  Stefano Soatto,et al.  Multi-View Stereo Reconstruction of Dense Shape and Complex Appearance , 2005, International Journal of Computer Vision.

[8]  Jiri Matas,et al.  Multiview 3D Tracking with an Incrementally Constructed 3D Model , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[9]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Roberto Cipolla,et al.  Automatic 3D object segmentation in multiple views using volumetric graph-cuts , 2007, Image Vis. Comput..

[11]  Gunnar Bolmsjö,et al.  ACROBOTER: a ceiling based crawling, hoisting and swinging service robot platform , 2009 .

[12]  Luc Van Gool,et al.  ViRoom - Low Cost Synchronized Multicamera System and Its Self-calibration , 2002, DAGM-Symposium.

[13]  Radu Horaud,et al.  TransforMesh : A Topology-Adaptive Mesh-Based Approach to Surface Evolution , 2007, ACCV.

[14]  Volkan Cevher,et al.  Compressed sensing for multi-view tracking and 3-D voxel reconstruction , 2008, 2008 15th IEEE International Conference on Image Processing.

[15]  Adrian Kaehler,et al.  Learning opencv, 1st edition , 2008 .

[16]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[17]  Hong Qin,et al.  Shape Reconstruction from 3D and 2D Data Using PDE-Based Deformable Surfaces , 2004, ECCV.

[18]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.