A segmentation based approach for shape recovery from multi-color images

Conventional shape from shading (SFS) algorithms are unable to deal with multi-color image satisfactory. This is because the assumption of constant surface albedo in the algorithms is not applicable to multi-color images. This paper proposes a new SFS approach for multi-color images through a segmentation-based shading recovery technique. With this technique a gray image is firstly extracted from the multi-color image containing better shading information compared with other color-to-gray conversion methods. The shading is recovered in the gray image as if the objects were made of single color. Shape of the multi-color object can then be recovered by classical gray-scaled SFS methods. Experimental results with synthetic and real multi-color images are presented. The obtained results corroborate that the proposed scheme is able to deliver better performance compared with other color SFS methods.

[1]  Hung-Tat Tsui,et al.  Shape from shading for non-Lambertian surfaces from one color image , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Tommy W. S. Chow,et al.  Enhanced 3D Shape Recovery Using the Neural-Based Hybrid Reflectance Model , 2001, Neural Computation.

[3]  Berthold K. P. Horn SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[4]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[5]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[6]  M. Shah,et al.  Shape from shading with variable albedo , 1998 .

[7]  Tommy W. S. Chow,et al.  A New Color 3D SFS Methodology Using Neural-Based Color Reflectance Models and Iterative Recursive Method , 2002, Neural Computation.

[8]  Pascal Fua,et al.  Variable albedo surface reconstruction from stereo and shape from shading , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Dimitris N. Metaxas,et al.  Incorporating Illumination Constraints in Deformable Models for Shape from Shading and Light Direction Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Ambrose E. Ononye,et al.  Estimating the Shape of A Surface with Non-Constant Reflectance from a Single Color Image , 2002, BMVC.

[11]  B. S. Manjunath,et al.  Edge flow: A framework of boundary detection and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[13]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[15]  P. Dupuis,et al.  An Optimal Control Formulation and Related Numerical Methods for a Problem in Shape Reconstruction , 1994 .

[16]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..