Photo-realistic 3D model reconstruction

Photo-realistic 3D modeling is a challenging problem and has been a research topic for many years. Quick generation of photo-realistic three-dimensional calibrated models using a hand-held device is highly desirable for applications ranging from forensic investigation, mining, to mobile robotics. In this paper, we present the instant Scene Modeler (iSM), a 3D imaging system that automatically creates 3D models using an off-the-shelf hand-held stereo camera. The user points the camera at a scene of interest and the system will create a photo-realistic 3D calibrated model automatically within minutes. Field tests in various environments have been carried out with promising results

[1]  Patrick Hébert A self-referenced hand-held range sensor , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Reinhard Koch,et al.  Hand-held acquisition of 3D models with a video camera , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[4]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[5]  Ulrich Neumann,et al.  A self-tracking augmented reality system , 1996, VRST.

[6]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[7]  David Nistér Automatic passive recovery of 3D from images and video , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[8]  James J. Little,et al.  Vision-based global localization and mapping for mobile robots , 2005, IEEE Transactions on Robotics.

[9]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  Piotr Jasiobedzki,et al.  Instant Scene Modeler for Crime Scene Reconstruction , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[12]  David Nist Automatic Passive Recovery of 3D from Images and Video , 2004 .

[13]  Marc Rioux,et al.  A texture-mapping approach for the compression of colored 3D triangulations , 1996, The Visual Computer.

[14]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[15]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[16]  Gerhard Roth,et al.  An Efficient Volumetric Method for Building Closed Triangular Meshes from 3-D Image and Point Data , 1997, Graphics Interface.

[17]  Voicu Popescu,et al.  The ModelCamera: a hand-held device for interactive modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[18]  Clark F. Olson,et al.  Robust stereo ego-motion for long distance navigation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.