Shape reconstruction from two color images using photometric stereo combined with segmentation and stereopsis

Most objects in a scene of our interest in reconstructing their shapes may have colors on them. Existing photometric methods require at least three images with different light directions to reconstruct the shape. If accurate shapes are obtainable even from two images, the construction of such an observation system may be much easier and its operation may be much speedier. In this paper we combine our photometric stereo method with color segmentation and the binocular stereopsis. First, color segmentation is applied to the images and component shapes are reconstructed from the segmented images. Then, the feature points of the components are estimated using the stereopsis not only to put them together to get the whole shape but also to reconstruct the scene. Basic experimental results are presented.

[1]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[2]  Dimitris N. Metaxas,et al.  Incorporating illumination constraints in deformable models , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[4]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Osamu Ikeda,et al.  Segmentation of faces in video footage using HSV color for face detection and image retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[6]  Reinhard Klette,et al.  Computer vision - three-dimensional data from images , 1998 .

[7]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[8]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[9]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Maria Petrou,et al.  Colour photometric stereo: simultaneous reconstruction of local gradient and colour of rough textured surfaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.