Specularity removal and relighting of 3D object model for virtual exhibition

To create photorealistic three-dimensional (3D) model of real objects is a challenging computer vision problem. While there are methods for 3D digitization of objects with high geometric resolution, there are still limitations in achieving high textural resolution. One problem is that the object surface exhibits specular reflection of illuminated light during the image acquisition. We propose a method that is applicable for the separation of diffuse and specular reflection components in multi-view image sequence. The specular chromaticity is replaced by the corresponding diffuse chromaticity which can always be found in neighboring views with the highlights already faded away. The diffuse image sequence is used to create the texture map. The 3D object model is relit for virtual exhibition. Our method is able to remove wide lobe highlights and maintain high fidelity in the texture boundary.

[1]  K. Ikeuchi,et al.  Color constancy through inverse-intensity chromaticity space. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[3]  Stephen Lin,et al.  Separation of Highlight Reflections on Textured Surfaces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Katsushi Ikeuchi,et al.  Separating reflection components of textured surfaces using a single image , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Stephen Lin,et al.  Diffuse-Specular Separation and Depth Recovery from Image Sequences , 2002, ECCV.

[6]  Stephen Lin,et al.  Separation of diffuse and specular reflection in color images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  David J. Kriegman,et al.  Specularity Removal in Images and Videos: A PDE Approach , 2006, ECCV.

[8]  Stephen Lin,et al.  Highlight removal by illumination-constrained inpainting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.