Incorporating illumination constraints in deformable models

We present a method for the integration of illumination constraints within a deformable model framework. These constraints are incorporated as nonlinear holonomic constraints in the Lagrange equations of motion governing the deformation of the model. For improved numerical performance we employ the Baumgarte stabilization method. Our methodology is general and can be used for a broad range of illumination constraints. This approach avoids commonly used approximations in shape from shading, such as linearization, and the use of partial differential equations, which require initial boundary conditions. Furthermore, global and local parameterizations of the deformable models allow an improved estimation of shape from shading. We demonstrate this improvement over previously used approaches through a series of experiments on standardized sets of real and synthetic data.

[1]  John Oliensis,et al.  A global algorithm for shape from shading , 1993, 1993 (4th) International Conference on Computer Vision.

[2]  Dimitris N. Metaxas,et al.  The integration of optical flow and deformable models with applications to human face shape and motion estimation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  C.-C. Jay Kuo,et al.  Shape from Shading with a Linear Triangular Element Surface Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Dimitris N. Metaxas,et al.  Deformable model-based face shape and motion estimation , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[7]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[11]  J. Baumgarte.  Stabilization of constraints and integrals of motion in dynamical systems , 1972 .

[12]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.

[13]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[15]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[16]  Shang-Hong Lai,et al.  Physically Based Adaptive Preconditioning for Early Vision , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Shree K. Nayar,et al.  Diffuse reflectance from rough surfaces , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Pascal Fua,et al.  Imposing Hard Constraints on Deformable Models through Optimization in Orthogonal Subspaces , 1997, Comput. Vis. Image Underst..

[20]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[21]  A. Paul R. Cooper,et al.  A simple shape-from-shading algorithm applied to images of ice-covered terrain , 1994, IEEE Trans. Geosci. Remote. Sens..

[22]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[23]  Dimitris N. Metaxas.  Physics-Based Deformable Models: Applications to Computer Vision, Graphics, and Medical Imaging , 1996 .

[24]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[25]  Alex Pentland,et al.  Shape Information From Shading: A Theory About Human Perception , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[26]  Aaron F. Bobick,et al.  The direct computation of height from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Mubarak Shah,et al.  Analysis of shape from shading techniques , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  David A. Forsyth,et al.  Mutual illumination , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Alan H. Barr,et al.  Global and local deformations of solid primitives , 1984, SIGGRAPH.

[31]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .