A New Color 3D SFS Methodology Using Neural-Based Color Reflectance Models and Iterative Recursive Method

In this article, a new methodology for color shape from shading (SFS) problem is proposed. The problem of color SFS refers to the well-known fact that most real objects usually contain mixtures of diffuse and specular color reflections and are affected by the multicolored interreflection under unknown reflectivity. In this article, these limitations are addressed, and a new color SFS methodology is proposed. The proposed approach focuses on two main parts. First, a generalized neural-based color reflectance model is developed. Second, an iterative recursive method is developed to reconstruct a multicolor 3D surface. Experimental results on synthetic-colored objects and real-colored objects were performed to demonstrate the performance of the proposed methodology.

[1]  Hung-Tat Tsui,et al.  Shape from shading for non-Lambertian surfaces from one color image , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[3]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[4]  Tommy W. S. Chow,et al.  Shape recovery from shading by a new neural-based reflectance model , 1999, IEEE Trans. Neural Networks.

[5]  Deepa Kundur,et al.  A novel blind deconvolution scheme for image restoration using recursive filtering , 1998, IEEE Trans. Signal Process..

[6]  Steven A. Shafer,et al.  Anatomy of a color histogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Huang Yumin,et al.  A PHYSICAL APPROACH TO COLOR IMAGE UNDERSTANDING , 1991 .

[8]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[9]  Takeo Kanade,et al.  Shape from interreflections , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[10]  W. P. Cheung,et al.  Direct shape from shading with improved rate of convergence , 1997, Pattern Recognit..

[11]  B K Horn,et al.  Calculating the reflectance map. , 1979, Applied optics.

[12]  Berthold K. P. Horn.  Height and gradient from shading , 1989, International Journal of Computer Vision.

[13]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[14]  Tommy W. S. Chow,et al.  Improved blind image restoration scheme using recurrent filtering , 2000 .

[15]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  T. Kanade,et al.  USING A COLOR REFLECTION MODEL TO SEPARATE HIGHLIGHTS FROM OBJECT COLOR , 1987 .

[17]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[18]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[19]  Tommy W. S. Chow,et al.  Enhanced 3D Shape Recovery Using the Neural-Based Hybrid Reflectance Model , 2001, Neural Computation.

[20]  John Edward Warnock,et al.  A hidden surface algorithm for computer generated halftone pictures , 1969 .

[21]  Sang Wook Lee,et al.  Detection of Specularity Using Color and Multiple Views , 1992, ECCV.

[22]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[25]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[26]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[27]  C.-C. Jay Kuo,et al.  Shape from Shading with a Generalized Reflectance Map Model , 1997, Comput. Vis. Image Underst..

[28]  Tommy W. S. Chow,et al.  Learning parametric specular reflectance model by radial basis function network , 2000, IEEE Trans. Neural Networks Learn. Syst..

[29]  Tommy W. S. Chow,et al.  Training multilayer neural networks using fast global learning algorithm - least-squares and penalized optimization methods , 1999, Neurocomputing.

[30]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[32]  P. Beckmann,et al.  The scattering of electromagnetic waves from rough surfaces , 1963 .

[33]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[34]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.