Instant Casting Movie Theater: The Future Cast System

We have developed a visual entertainment system called “Future Cast” which enables anyone to easily participate in a pre-recorded or pre-created film as an instant CG movie star. This system provides audiences with the amazing opportunity to join the cast of a movie in real-time. The Future Cast System can automatically perform all the processes required to make this possible, from capturing participants' facial characteristics to rendering them into the movie. Our system can also be applied to any movie created using the same production process. We conducted our first experimental trial demonstration of the Future Cast System at the Mitsui-Toshiba pavilion at the 2005 World Exposition in Aichi Japan.

[1]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[2]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, ACM Trans. Graph..

[3]  Hyeong-Seok Ko,et al.  Performance-driven muscle-based facial animation , 2001, Comput. Animat. Virtual Worlds.

[4]  Tomaso A. Poggio,et al.  Reanimating Faces in Images and Video , 2003, Comput. Graph. Forum.

[5]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[6]  Dimitris N. Metaxas,et al.  The integration of optical flow and deformable models with applications to human face shape and motion estimation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Mathieu Desbrun,et al.  Learning controls for blend shape based realistic facial animation , 2003, SIGGRAPH '03.

[8]  Tony Ezzat,et al.  Trainable videorealistic speech animation , 2002, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[9]  Bao-Liang Lu,et al.  Gender Recognition Using a Min-Max Modular Support Vector Machine , 2005, ICNC.

[10]  Jun-yong Noh,et al.  Animated deformations with radial basis functions , 2000, VRST '00.

[11]  Sung Yong Shin,et al.  Scattered Data Interpolation with Multilevel B-Splines , 1997, IEEE Trans. Vis. Comput. Graph..

[12]  Ming-Hsuan Yang,et al.  Gender classification with support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[13]  Gladimir V. G. Baranoski,et al.  A Biophysically‐Based Spectral Model of Light Interaction with Human Skin , 2004, Comput. Graph. Forum.

[14]  Tim Weyrich,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[15]  Pedro V. Sander,et al.  Real-time skin rendering on graphics hardware , 2004, SIGGRAPH '04.

[16]  Hanspeter Pfister,et al.  Face transfer with multilinear models , 2005, SIGGRAPH 2005.

[17]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[18]  Nur Arad,et al.  Image Warping Using Few Anchor Points and Radial Functions , 1995, Comput. Graph. Forum.

[19]  Shihong Lao,et al.  Vision-Based Face Understanding Technologies and Their Applications , 2004, SINOBIOMETRICS.

[20]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[21]  Yukinori Matsumoto,et al.  Multicamera 3D modeling system to digitize human head and body , 2001, IS&T/SPIE Electronic Imaging.

[22]  Michael J. Lyons,et al.  Avatar creation using automatic face processing , 1998, MULTIMEDIA '98.

[23]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[24]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[25]  Jing Xiao,et al.  Vision-based control of 3D facial animation , 2003, SCA '03.