Analysis of lip motion using principal component analyses.

OBJECTIVES The aim of this study was to quantitatively determine lip movement characteristics during the phonation of Japanese vowels. MATERIALS AND METHODS Lip motions of 14 normal individuals during the phonation of five Japanese vowels, /a/, /i/, /u/, /e/, and /o/ were analyzed. Using our developed motion analyzing system, range images were produced across the whole sequence during lip motions, and virtual grids were fitted onto surfaces. Principal component analyses were applied with three-dimensional coordinates of intersections for virtual grids regarded as variables. RESULTS AND CONCLUSION The fourth and fifth principal component scores were shown to be parameters that control mouth opening and the retraction of the corners of the mouth, respectively. Discriminate analyses show it is possible to distinguish motion during the phonation of /u/ from that of other vowels.

[1]  Tomohiro Yamada,et al.  Production of a range image for facial motion analysis: A method for analyzing lip motion , 2006, Comput. Medical Imaging Graph..

[2]  Linstrom Cj,et al.  Facial-motion analysis with a video and computer system: a preliminary report. , 2000 .

[3]  C. Tzou,et al.  Three-dimensional video-analysis of facial movements in healthy volunteers. , 2003, British journal of plastic surgery.

[4]  C A Trotman,et al.  A comparison of three-dimensional and two-dimensional analyses of facial motion. , 1996, The Angle orthodontist.

[5]  R. Bracewell.  Computer Image Processing , 1979 .

[6]  N. Schwenzer,et al.  Quantitative 3D soft tissue analysis of symmetry prior to and after unilateral cleft lip repair compared with non-cleft persons (performed in Cambodia). , 2008, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[7]  J. Cohn,et al.  Automated Tracking of Facial Features in Patients with Facial Neuromuscular Dysfunction , 2001, Plastic and reconstructive surgery.

[8]  Thomas K. Pilgram,et al.  Facial surface scanner , 1991, IEEE Computer Graphics and Applications.

[9]  Julian J Faraway,et al.  Modeling facial movement: I. A dynamic analysis of differences based on skeletal characteristics. , 2004, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[10]  Peter Proff,et al.  Functional 3-D analysis of patients with unilateral cleft of lip, alveolus and palate (UCLAP) following lip repair. , 2006, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[11]  A. Jenny,et al.  Development of a New Documentation System for Facial Movements as a Basis for the International Registry for Neuromuscular Reconstruction in the Face , 1994, Plastic and reconstructive surgery.

[12]  J. Faraway,et al.  Sensitivity of a Method for the Analysis of Facial Mobility. II. Interlandmark Separation , 1998 .

[13]  Wendy L Gilleard,et al.  Three-Dimensional Quantification of the Symmetry of Normal Facial Movement , 2002, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[14]  W. Shaw,et al.  Use of standardized video recordings to assess cleft surgery outcome. , 1996, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[15]  R. Balliet,et al.  Simultaneous Quantitation of Facial Movements: The Maximal Static Response Assay of Facial Nerve Function , 1994, Annals of plastic surgery.

[16]  S E Coulson,et al.  Quantification of the Three-Dimensional Displacement of Normal Facial Movement , 2000, The Annals of otology, rhinology, and laryngology.

[17]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Tomohiro Yamada,et al.  Development and Clinical Usage of a Motion Analysis System for the Face: Preliminary Report , 2004, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[19]  CurlessBrian,et al.  The space of human body shapes , 2003 .

[20]  E Stüssi,et al.  Three-dimensional video analysis of facial movements: a new method to assess the quantity and quality of the smile. , 1999, Plastic and reconstructive surgery.

[21]  G. Essick,et al.  Three-dimensional nasolabial displacement during movement in repaired cleft lip and palate patients. , 2000 .

[22]  S E Coulson,et al.  Three-Dimensional Quantification of “Still” Points during Normal Facial Movement , 1999, The Annals of otology, rhinology, and laryngology.

[23]  J. Faraway,et al.  Sensitivity of a method for the analysis of facial mobility. I. Vector of displacement. , 1998, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[24]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[25]  C. Aubá,et al.  Automatic three-dimensional quantitative analysis for evaluation of facial movement. , 2008, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[26]  D J Johnston,et al.  Are Facial Expressions Reproducible? , 2003, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[27]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[28]  C. Stohler,et al.  Measurement of facial soft tissue mobility in man. , 1998, The Cleft Palate-Craniofacial Journal.