3D Face Reconstruction from Single Two-Tone and Color Images

We explore the role of top-down processes in the recovery of the 3D shape of faces from single images. Class familiarity appears to play a significant role in the perception of shape in single images, as is demonstrated by the perception of two-tone (“Mooney”) images. We prove that under standard shape from shading assumptions, a Mooney image can give rise to multiple different 3D reconstructions. We further present an algorithm that by using just a single reference shape model—the face of a different individual or an average face—can achieves veridical reconstructions from two-tone images as well as gray-level and color images downloaded from the Internet.

[1]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[2]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.

[3]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Timothy F. Cootes,et al.  Face recognition using the active appearance model. , 1998, European Conference on Computer Vision.

[6]  Jay Hegdé,et al.  Identifying faces in two-tone ('Mooney') images: A psychophysical and fMRI study , 2010 .

[7]  Paul Debevec,et al.  13th Eurographics Workshop on Rendering , 2002 .

[8]  Ira Kemelmacher-Shlizerman,et al.  Face reconstruction in the wild , 2011, 2011 International Conference on Computer Vision.

[9]  Paul A. Griffin,et al.  Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two-Dimensional Images , 1996, Neural Computation.

[10]  T. Kanade,et al.  Combining Models and Exemplars for Face Recognition: An Illuminating Example , 2001 .

[11]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[12]  Jonathan Winawer,et al.  Mooney image perception in preschool-aged children , 2007 .

[13]  B. Julesz.  Foundations of Cyclopean Perception , 1971 .

[14]  Rama Chellappa,et al.  Characterization of Human Faces under Illumination Variations Using Rank, Integrability, and Symmetry Constraints , 2004, ECCV.

[15]  Ira Kemelmacher-Shlizerman,et al.  Molding Face Shapes by Example , 2006, ECCV.

[16]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[17]  J. Tsitsiklis,et al.  Efficient algorithms for globally optimal trajectories , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[18]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[19]  Patrick Cavanagh,et al.  Recovery of 3D volume from 2-tone images of novel objects , 1998, Cognition.

[20]  B. Renault,et al.  Face and shape repetition effects in humans: a spatio‐temporal ERP study , 1997, Neuroreport.

[21]  C. M. Mooney.  Age in the development of closure ability in children. , 1957, Canadian journal of psychology.

[22]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[23]  Ira Kemelmacher-Shlizerman,et al.  Face Reconstruction from a Single Image using a Single Reference Face Shape , 2009 .

[24]  Lei Zhang,et al.  Face recognition under variable lighting using harmonic image exemplars , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[25]  Timothy F. Cootes,et al.  Modelling the variability in face images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[26]  Edwin R. Hancock,et al.  Recovering facial shape and albedo using a statistical model of surface normal direction , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[27]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Karl J. Friston,et al.  How the brain learns to see objects and faces in an impoverished context , 1997, Nature.

[29]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[30]  Ira Kemelmacher-Shlizerman,et al.  3D shape reconstruction of Mooney faces , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.