Determination of Head Pose and Facial Expression from a Single Perspective View by Successive Scaled Orthographic Approximations

Human faces are the main organs for expressing human emotion. In this study, a new iterative approach to analyzing the head pose and the facial expression of a human face from a single image is proposed. The proposed approach extends the concept of successive scaled orthographic approximations, which was used to estimate the pose of a rigid object, to develop a method to estimate the parameters for a non-rigid object, namely, a human face. The implementation of the proposed method is simple; furthermore, no initial guess is required. The convergency property of the proposed method is also analyzed theoretically and experimentally. Experimental results show that the proposed method is robust and has a high percentage of convergency, and thus prove the feasibility of the proposed approach.

[1]  Berthold K. P. Horn.  Relative orientation , 1987, International Journal of Computer Vision.

[2]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[3]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  Kiyoharu Aizawa,et al.  Analysis and synthesis of facial image sequences in model-based image coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[7]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Yiannis Aloimonos,et al.  Perspective approximations , 1990, Image Vis. Comput..

[9]  Thomas S. Huang,et al.  Bézier Volume Deformation Model for Facial Animation and Video Tracking , 1998, CAPTECH.

[10]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Keith Waters,et al.  Computer facial animation , 1996 .

[12]  J. Stoer,et al.  Introduction to Numerical Analysis , 2002 .

[13]  Ja-Ling Wu,et al.  A three-dimensional muscle-based facial expression synthesizer for model-based image coding , 1996, Signal Process. Image Commun..

[14]  Fadi Dornaika,et al.  Object Pose: The Link between Weak Perspective, Paraperspective, and Full Perspective , 1997, International Journal of Computer Vision.

[15]  Haibo Li,et al.  Two-view facial movement estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[16]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[17]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[18]  Prem Kalra,et al.  Face to virtual face , 1998, Proc. IEEE.

[19]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[20]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[21]  Andrew Blake,et al.  Separability of pose and expression in facial tracking and animation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Liang Zhang,et al.  Automatic adaptation of a face model using action units for semantic coding of videophone sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..