3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera

Three-dimensional (3D) objects reconstruction using just bi-dimensional (2D) images has been a major research topic in Computer Vision. However, it is still a hard problem to address, when automation, speed and precision are required and/or the objects have complex shapes or image properties. In this paper, we compare two Active Computer Vision methods frequently used for the 3D reconstruction of objects from image sequences, acquired with a single off-the-shelf CCD camera: Structure From Motion (SFM) and Generalized Voxel Coloring (GVC). SFM recovers the 3D shape of an object based on the relative motion involved, while VC is a volumetric method that uses photo-consistency measures to build the required 3D model. Both methods considered do not impose any kind of restrictions on the relative motion involved.

[1]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[4]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  Rama Chellappa,et al.  Estimating the Kinematics and Structure of a Rigid Object from a Sequence of Monocular Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  François Chaumette,et al.  Structure from motion using an active vision paradigm , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[8]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[9]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[11]  Jitendra Malik,et al.  Recovering photometric properties of architectural scenes from photographs , 1998, SIGGRAPH.

[12]  Thomas Malzbender,et al.  Generalized Voxel Coloring , 1999, Workshop on Vision Algorithms.

[13]  Suchendra M. Bhandarkar,et al.  Machine Vision and Applications c ○ Springer-Verlag 1999 CATALOG: a system for detection and rendering of internal log defects using computer tomography , 1997 .

[14]  Emanuele Trucco,et al.  Projective rectification without epipolar geometry , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[15]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ioannis A. Kakadiaris,et al.  Applications of Virtual Reality in Surgery , 2000 .

[18]  Frank Dellaert,et al.  Structure from motion without correspondence , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Roland Siegwart,et al.  Multisensor on-the-fly localization: : Precision and reliability for applications , 2001, Robotics Auton. Syst..

[20]  P. Tikuisis,et al.  Human body surface area: measurement and prediction using three dimensional body scans , 2001, European Journal of Applied Physiology.

[21]  Henrik Aanæs,et al.  Estimation of Deformable Structure and Motion , 2002 .

[22]  Martin Kampel,et al.  Combining shape from silhouette and shape from structured light for volume estimation of archaeological vessels , 2002, Object recognition supported by user interaction for service robots.

[23]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Roberto Cipolla,et al.  Building Architectural Models from Many Views Using Map Constraints , 2002, ECCV.

[25]  Jean-Christophe Nebel,et al.  Study of the breathing pattern based on 4D data collected by a dynamic 3D body scanner , 2002 .

[26]  Niels Lynnerup,et al.  Facial image identification using Photomodeler. , 2003, Legal medicine.

[27]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[28]  Martin Jägersand,et al.  Image-based localization with depth-enhanced image map , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[29]  Jean-Christophe Nebel,et al.  V-Man generation for 3-D real time animation , 2003 .

[30]  Yolanda González Cid,et al.  Real-time 3d SLAM with wide-angle vision , 2004 .

[31]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[32]  Carlo Tomasi,et al.  Depth Discontinuities by Pixel-to-Pixel Stereo , 1999, International Journal of Computer Vision.

[33]  John Oliensis,et al.  A Multi-Frame Structure-from-Motion Algorithm under Perspective Projection , 1999, International Journal of Computer Vision.

[34]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[35]  Christian Früh,et al.  An Automated Method for Large-Scale, Ground-Based City Model Acquisition , 2004, International Journal of Computer Vision.

[36]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[37]  Alberto Guarnieri,et al.  3D modeling of close-range objects: photogrammetry or laser scanning? , 2005 .

[38]  Nadia Magnenat-Thalmann,et al.  From early virtual garment simulation to interactive fashion design , 2005, Comput. Aided Des..

[39]  Guangjun Zhang,et al.  3D vision inspection for internal surface based on circle structured light , 2005 .

[40]  Carlo S. Regazzoni,et al.  Dynamic Scene Reconstruction for Efficient Remote Surveillance , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[41]  Superior vena cava syndrome: a 3D CT-scan reconstruction. , 2006, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[42]  Gabriele Guidi,et al.  Three-dimensional acquisition of large and detailed cultural heritage objects , 2006, Machine Vision and Applications.

[43]  Hui Ji.  A holistic approach to structure from motion , 2006 .

[44]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[45]  Ravindra S. Goonetilleke,et al.  Foot measurements from three-dimensional scans: A comparison and evaluation of different methods , 2006 .

[46]  Wolfgang Straßer,et al.  3D Surveillance A Distributed Network of Smart Cameras for Real-Time Tracking and its Visualization in 3D , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[47]  N.H. Mahmood,et al.  3D Reconstruction From Multiple Views For Orthotic and Prosthetic Design: An Overview , 2006, 2006 4th Student Conference on Research and Development.

[48]  Jie Chen,et al.  Architectural Modeling from Sparsely Scanned Range Data , 2008, International Journal of Computer Vision.

[49]  João Manuel R. S. Tavares,et al.  3D volumetric reconstruction and characterization of objects from uncalibrated images , 2007 .

[50]  LiMei Song,et al.  Improved SFS 3D measurement based on BP neural network , 2007, Image Vis. Comput..

[51]  Sherin M. Youssef,et al.  Automated barcode recognition for smart identification and inspection automation , 2007, Expert Syst. Appl..

[52]  Martin Kampel,et al.  Rule based system for archaeological pottery classification , 2007, Pattern Recognit. Lett..

[53]  Yohan Payan,et al.  3D statistical models for tooth surface reconstruction , 2007, Comput. Biol. Medicine.

[54]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[55]  William E. Higgins,et al.  Computer-based system for the virtual-endoscopic guidance of bronchoscopy , 2007, Comput. Vis. Image Underst..

[56]  Anestis Koutsoudis,et al.  On 3D reconstruction of the old city of Xanthi. A minimum budget approach to virtual touring based on photogrammetry , 2007 .

[57]  AUGMENTED REALITY USING REGISTRATION OF 3D COMPUTED TOMOGRAPHY TO STEREOSCOPIC VIDEO OF LAPAROSCOPIC RENAL SURGERY , 2008 .

[58]  M. Mueller,et al.  The role of 3D fusion imaging in sentinel lymphadenectomy for vulvar cancer. , 2008, Gynecologic oncology.

[59]  Sangwon Lee,et al.  Automatic construction of 3D models from architectural line drawings , 2008, I3D '08.

[60]  Joong Lee,et al.  Efficient height measurement method of surveillance camera image. , 2008, Forensic science international.

[61]  J. P. Lewis.  Fast Normalized Cross-Correlation , 2010 .