Creating Photorealistic Virtual Model with Polarization based Vision System

Recently D models are used in many elds such as education medical services entertainment art digital archive etc because of the progress of computational time and demand for creating photorealistic virtual model is increasing for higher reality In computer vision eld a number of techniques have been developed for creating the virtual model by observing the real object in computer vision eld In this paper we propose the method for creating photorealistic virtual model by using laser range sensor and polarization based image capture system We capture the range and color images of the object which is rotated on the rotary table In geometry aspect an object surface shape is reconstructed by merging multiple range images of the object In optical aspect color images are captured under xed point light source By using the reconstructed object shape and sequence of color images of the object parameter of a re ection model are estimated in a robust manner As a result then we can make photorealistic D model in consideration of surface re ection The key point of the proposed method is that rst the di use and specular re ection components are separated from the color image sequence and then re ectance parameters of each re ection component are estimated separately In separation of re ection components we use polarization lter This approach enables estimation of re ectance properties of real objects whose surfaces show specularity as well as di usely re ected lights The recovered object shape and re ectance properties are then used for synthesizing object images with realistic shading e ects under arbitrary illumination conditions

[1]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[2]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[3]  Andrew Gardner,et al.  A lighting reproduction approach to live-action compositing , 2002, SIGGRAPH.

[4]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[5]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[6]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[8]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[9]  Yoav Y. Schechner,et al.  Polarization-based decorrelation of transparent layers: The inclination angle of an invisible surface , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Katsushi Ikeuchi,et al.  Measurement of surface orientations of transparent objects using polarization in highlight , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[12]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1994 .

[13]  Athinodoros S. Georghiades,et al.  Recovering 3-D Shape and Reflectance From a Small Number of Photographs , 2003, Rendering Techniques.

[14]  Shree K. Nayar,et al.  Removal of specularities using color and polarization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Terrance E. Boult,et al.  Physically-based edge labeling , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Katsushi Ikeuchi,et al.  Eigen-Texture Method: Appearance Compression and Synthesis Based on a 3D Model , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..