Processing of Face Images and Its Applications

Human faces convey various information, including that is specific to each individual person and that is part of mutual communication among persons. Information exhibited by a “face” is what is called “non-verbal information” and usually verbal media cannot easily describe such information appropriately. Recently, detailed studies on the processing of face images by a computer have been carried out in the engineering field for applications to communication media and human computer interaction as well as automatic identification of human faces. Two main technical topics are the recognition of human faces and the synthesis of face images. The objective of the former is to enable a computer to detect and identify users and further to recognize their facial expressions, while that of the latter is to provide a natural and impressive user interface on a computer in the form of a “face.” These studies have also been found to be useful in various non-engineering fields related to a face, such as psychology, anthropology, cosmetology and dentistry. Most of the studies in these different fields have been carried out independently up to now, although all of them deal with a “face.” Now in virtue of the progress in the above engineering technologies a common study tools and databases for facial information have become available. On the basis of these backgrounds, this paper surveys recent research trends in the processing of face images by a computer and its typical applications. Firstly, the various characteristics of faces are considered. Secondly, recent research activities in the recognition and synthesis of face images are outlined. Thirdly, the applications of digital processing methods of facial information are discussed from several standpoints: intelligent image coding, media handling, human computer interaction, caricature, facial impression, psychological and medical applications. The common tools and databases used in the studies of processing of facial information and some related topics are also described. key words: face, facial information, recognition of face images, synthesis of face images, applications, tools and databases

[1]  W. Lewis Johnson,et al.  Steve: an animated pedagogical agent for procedural training in virtual environments , 1997, SGAR.

[2]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[3]  Chil-Woo Lee,et al.  Automatic recognition of human facial expressions , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Kazuo Kyuma,et al.  Face Recognition System Using Local Autocorrelations and Multiscale Integration , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  O. Hasegawa,et al.  CG Tool for Constructing Anthropomorphic Interface Agents , 1997, IJCAI 1997.

[6]  Fumio Hara,et al.  Real-time Recognition of 6 Basic Facial Expressions , 1996 .

[7]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Mitsuru Ishizuka,et al.  Real-time parallel and cooperative recognition of facial images for an interactive visual human interface , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 2 - Conference B: Computer Vision & Image Processing. (Cat. No.94CH3440-5).

[9]  Fumio Hara,et al.  Study on Face Robot for Active Human Interface , 1994 .

[10]  Alex Pentland,et al.  ALIVE: Artificial Life Interactive Video Environment , 1994, AAAI.

[11]  Henrique S. Malvar,et al.  Making Faces , 2019, Topoi.

[12]  Christoph von der Malsburg,et al.  Recognizing Faces by Dynamic Link Matching , 1996, NeuroImage.

[13]  David G. Stork,et al.  Speechreading: an overview of image processing, feature extraction, sensory integration and pattern recognition techniques , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[14]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[16]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  H. Harashima,et al.  Model-Based Analysis Synthesis Coding of Videotelephone Images--Conception and Basic Study of Intelligent Image Coding-- , 1989 .

[18]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[19]  Masahide Kaneko,et al.  Processing of facial information by computer , 1998 .

[20]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Hyeonjoon Moon,et al.  The FERET verification testing protocol for face recognition algorithms , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[22]  Kiyoo Itoh,et al.  An Experimental Multimodal Disputation System , 1997 .

[23]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[24]  Michael J. Black,et al.  Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[25]  Akikazu Takeuchi,et al.  Social Interaction: Multimodal Conversation with Social Agents , 1994, AAAI.

[26]  Masahide Kaneko,et al.  ANALYSIS OF FACIAL IMPRESSIONS USING AVERAGE FACES , 1998 .

[27]  Shigeo Morishima,et al.  Construction and Evaluation of 3-D Emotion Space Based on Facial Image Analysis , 1997 .

[28]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[29]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[30]  DaugmanJohn.  Face and Gesture Recognition , 1997 .

[31]  Takio Kurita,et al.  A face recognition method using higher order local autocorrelation and multivariate analysis , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[32]  Timothy F. Cootes,et al.  A unified approach to coding and interpreting face images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[33]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[35]  Takeo Kanade,et al.  Computer recognition of human faces , 1980 .

[36]  Takeo Kanade,et al.  Name-It: Naming and Detecting Faces in Video by the Integration of Image and Natural Language Processing , 1997, IJCAI.

[37]  Shigeru Akamatsu.  Computer recognition of human face - A survey , 1999, Systems and Computers in Japan.

[38]  Charles B. Callaway,et al.  Cosmo: A Life-like Animated Pedagogical Agent with Deictic Believability (cid:3) , 1997 .

[39]  Hiroshi Harashima,et al.  Interactive Synthesis of Facial Images based on 3-dimensional Model , 1996 .

[40]  Hiroyasu Koshimizu,et al.  Facial Caricaturing Based on Visual Illusion--A Mechanism to Evaluate Caricature in PICASSO System-- , 1993 .

[41]  T. Rist.  Webpersona: a Life-like Presentation Agent for the World-wide Web , 1997 .

[42]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Masahide Kaneko,et al.  Facial Caricature by Computer Based on the Style of Individual Human Caricaturist , 1997 .