Fusing Spatial, Pictorial and Photometric Data to Build Photorealistic Models

We are working on several projects related to the automatic fusion and high-level interpretation of 3D sensor data for building models of real-world objects and scenes. Our major goal is to create rich and geometrically correct, scalable photorealistic 3D models based on multimodal data obtained using a laser scanner, a camera and illumination sources. In this report, we present a sophisticated software system that processes and fuses geometric, pictorial and photometric data using genetic algorithms and efficient methods of computer vision.

[1]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[2]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[3]  Dmitry Chetverikov,et al.  Photo-consistency based registration of an uncalibrated image pair to a 3D surface model using genetic algorithm , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[4]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[5]  Francis J. M. Schmitt,et al.  3D reconstruction of real objects with high resolution shape and texture , 2004, Image Vis. Comput..

[6]  Anikó Ekárt,et al.  Creating Photorealistic Models by Data Fusion with Genetic Algorithms , 2007 .

[7]  Géza Kós.  An Algorithm to Triangulate Surfaces in 3D Using Unorganised Point Clouds , 1999, Geometric Modelling.

[8]  Marc Levoy,et al.  The digital Michelangelo project , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[9]  Tamás Várady,et al.  Parameterizing complex triangular meshes , 2003 .

[10]  Daniel Rueckert,et al.  Using Photo-Consistency to Register 2D Optical Images of the Human Face to a 3D Surface Model , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[12]  Atsushi Nakazawa,et al.  The great buddha project: modeling cultural heritage for VR systems through observation , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Pavel Krsek,et al.  Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm , 2005, Image Vis. Comput..

[16]  Dmitry Chetverikov,et al.  Photo-consistency based registration of an uncalibrated image pair to a 3D surface model using genetic algorithm , 2004 .

[17]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[18]  Philip David,et al.  SoftPOSIT: Simultaneous Pose and Correspondence Determination , 2002, International Journal of Computer Vision.