Modeling shapes and textures from images: new frontiers

Increasingly, models of the world are directly built from images. The paper discusses a number of recent developments that try to push the envelope of what image-based modeling can achieve. In particular the analysis of 3D surface deformations is discussed for face animation, the extraction of matches under wide baseline conditions for 3D scene reconstruction, and the synthesis of viewpoint dependent textures for realistic object rendering.

[1]  Gérard Bailly,et al.  MOTHER: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation , 2000, INTERSPEECH.

[2]  Adam Baumberg,et al.  Reliable feature matching across widely separated views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Paul A. Beardsley,et al.  Euclidean Structure from Uncalibrated Images , 1994, BMVC.

[4]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[5]  Kristin J. Dana,et al.  Compact representation of bidirectional texture functions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Luc Van Gool,et al.  PDE-based multi-view depth estimation , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[7]  Luc Van Gool,et al.  Multiview texture models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Jun-yong Noh,et al.  Expression cloning , 2001, SIGGRAPH.

[9]  Mike J. Chantler,et al.  Evaluating Kube and Pentland's fractal imaging model , 2001, IEEE Trans. Image Process..

[10]  Eric Vatikiotis-Bateson,et al.  The moving face during speech communication , 1998 .

[11]  John R. Wright,et al.  Synthesis of Speaker Facial Movement to Match Selected Speech Sequences , 1994 .

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Paul A. Viola.  Alignment by maximisation of mutual information , 1993 .

[14]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[15]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Jiri Matas,et al.  Distinguished Regions for Wide-baseline Stereo , 2001 .

[19]  Nicholas Ayache,et al.  Rigid, affine and locally affine registration of free-form surfaces , 1996, International Journal of Computer Vision.

[20]  Luc Van Gool,et al.  One-shot 3D-shape and Texture Acquisition of Facial Data , 1997, AVBPA.

[21]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[23]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1995, Proceedings of IEEE International Conference on Computer Vision.

[24]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[25]  Reinhard Koch,et al.  Matching of affinely invariant regions for visual servoing , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[26]  Tony Ezzat,et al.  Visual Speech Synthesis by Morphing Visemes , 2000, International Journal of Computer Vision.

[27]  A. Montgomery,et al.  Physical characteristics of the lips underlying vowel lipreading performance. , 1983, The Journal of the Acoustical Society of America.

[28]  Kristin J. Dana,et al.  Texture histograms as a function of irradiation and viewing direction , 1999, International Journal of Computer Vision.

[29]  André Oosterlinck,et al.  Range Image Acquisition with a Single Binary-Encoded Light Pattern , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Luc Van Gool,et al.  A Compact Model for Viewpoint Dependent Texture Synthesis , 2000, SMILE.

[31]  E. Owens,et al.  Visemes observed by hearing-impaired and normal-hearing adult viewers. , 1985, Journal of speech and hearing research.

[32]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.