A crucial investigation of facial skin colour research trend and direction

The research on facial animation is growing and became more sensible in terms of three dimensional data. The emergence of laser scans and advanced 3D tools imparted further towards the rapid development of complex facial model. This paper has given an overview on facial animation techniques such as blend shape interpolation, facial action coding system and parameterization. The major challenges, excitement, applications, recent progress and the future of various diversified facial animation methods are high-lighted as well. The emotional theory, involving the cognition as one of the elements of emotion and emphasizing on somatic factors describing emotional expressions and its perception as the other elements are presented. The essential factors responsible for emo-tional colors manifestations to an individual are the key issues. The notable theories and models of Goethe, Claudia Cortes, Naz Kaya, Color Wheel Pro, Shirley Willet and Yau Xueon facial colors expressions are critically commented and a facile comparison is car-ried out. Furthermore, a detailed discussions on facial colors appearance are provided using image based skin color analysis and synthesis, reflectance based model, bidirec-tional texture function, physiology measurement based and emotional appearance mod-els. The paper completed with the remarkable features official expression comprised of facial action coding system and MPEG-4 facial animation that enable considerable im-provement on facial animation technology. Our in-depth appraisal on facial animation may contribute as taxonomy towards the development of human facial skin colors on 3D avatar including facial action coding system, emotion theory, color theory, animation via blending and image based color analysis useful for various applications.

[1]  Hans-Peter Seidel,et al.  Scaled Motion Dynamics for Markerless Motion Capture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[3]  Abhijeet Ghosh,et al.  Practical modeling and acquisition of layered facial reflectance , 2008, SIGGRAPH 2008.

[4]  Nadia Magnenat-Thalmann,et al.  Believability and Interaction in Virtual Worlds , 2005, MMM.

[5]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH Courses.

[6]  Nadia Magnenat-Thalmann,et al.  Modeling of vascular expressions in facial animation , 1994, Proceedings of Computer Animation '94.

[7]  Robin J. S. Sloan,et al.  A practice-led approach to facial animation research , 2010, FAA '10.

[8]  Kyu Ho Park,et al.  Facial color adaptive technique based on the theory of emotion-color association and analysis of animation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[9]  John P. Lewis,et al.  Reducing blendshape interference by selected motion attenuation , 2005, I3D '05.

[10]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[11]  Verónica Orvalho,et al.  A practical appearance model for dynamic facial color , 2010, SIGGRAPH 2010.

[12]  Yin Chen,et al.  Fast capture of personalized avatar using two Kinects , 2014 .

[13]  Jos Stam,et al.  An Illumination Model for a Skin Layer Bounded by Rough Surfaces , 2001, Rendering Techniques.

[14]  Feng Dong,et al.  Building highly realistic facial modeling and animation: a survey , 2007, The Visual Computer.

[15]  Tim Weyrich,et al.  A layered, heterogeneous reflectance model for acquiring and rendering human skin , 2008, SIGGRAPH 2008.

[16]  Volker Strom,et al.  Visual prosody: facial movements accompanying speech , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[17]  Ahmad Hoirul Basori,et al.  The effect of emotional colour on creating realistic expression of avatar , 2012, VRCAI '12.

[18]  Bilal Ahmed,et al.  Rendering of human skin during physical exercise , 2012, SIGGRAPH '12.

[19]  Alan F. Smeaton,et al.  Investigating Biometric Response for Information Retrieval Applications , 2006, ECIR.

[20]  Isaac Kerlow,et al.  The Art of 3D Computer Animation and Effects , 2008 .

[21]  David Salesin,et al.  Resynthesizing facial animation through 3D model-based tracking , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Andrew Gardner,et al.  Performance geometry capture for spatially varying relighting , 2005, SIGGRAPH '05.

[23]  T. Yamada,et al.  Effects of facial color on virtual facial image synthesis for dynamic facial color and expression under laughing emotion , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[24]  Masaki Oshita,et al.  Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry , 2008, VRCAI 2008.

[25]  Zhigang Deng,et al.  Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[26]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[27]  Wolfgang Heidrich,et al.  Proceedings of the 17th Eurographics conference on Rendering Techniques , 2006 .

[28]  Gladimir V. G. Baranoski,et al.  A Biophysically‐Based Spectral Model of Light Interaction with Human Skin , 2004, Comput. Graph. Forum.

[29]  Jonathan Gratch,et al.  Expression of Emotions Using Wrinkles, Blushing, Sweating and Tears , 2009, IVA.

[30]  B. Bianchi,et al.  The masseteric nerve: a versatile power source in facial animation techniques. , 2014, The British journal of oral & maxillofacial surgery.

[31]  Keith Waters,et al.  Computer Facial Animation, Second Edition , 1996 .

[32]  Kristin J. Dana,et al.  Skin Texture Modeling , 2005, International Journal of Computer Vision.

[33]  Bing Zhou,et al.  Facial expression cloning with elastic and muscle models , 2014, J. Vis. Commun. Image Represent..

[34]  Eric Enderton,et al.  Efficient Rendering of Human Skin , 2007 .

[35]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962 .

[36]  Antonio Vallecillo,et al.  Model-driven performance analysis of rule-based domain specific visual models , 2013, Inf. Softw. Technol..

[37]  Joan Lasenby,et al.  Markerless motion capture with single and multiple cameras , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[38]  Hans-Peter Seidel,et al.  Markerless motion capture of man-machine interaction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Stephen Lin,et al.  Modeling and rendering of quasi-homogeneous materials , 2005, SIGGRAPH 2005.

[40]  M. Argyle.  The Psychology of Interpersonal Behaviour , 1967 .

[41]  Muhammad Abbas,et al.  Positivity-preserving rational bi-cubic spline interpolation for 3D positive data , 2014, Appl. Math. Comput..

[42]  Juan Buhler.  ACM SIGGRAPH 2005 Sketches , 2005 .

[43]  Matt Huenerfauth,et al.  Comparing native signers' perception of American Sign Language animations and videos via eye tracking , 2013, ASSETS.

[44]  Mickaël Raulet,et al.  MPEG Reconfigurable Video Coding: From specification to a reconfigurable implementation , 2013, Signal Process. Image Commun..

[45]  Hans-Peter Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[46]  Henrik Wann Jensen,et al.  A spectral BSSRDF for shading human skin , 2006, EGSR '06.

[47]  John P. Lewis,et al.  Automated eye motion using texture synthesis , 2005, IEEE Computer Graphics and Applications.

[48]  Christophe Hery.  Implementing a skin BSSRDF: (or several...) , 2005, SIGGRAPH Courses.

[49]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, SIGGRAPH Courses.

[50]  Andrew Gardner,et al.  Animatable Facial Reflectance Fields , 2004 .

[51]  O. Pos,et al.  Facial Expressions, Colours and Basic Emotions , 2012 .

[52]  Greg Turk,et al.  Efficient Estimation of Spatially Varying Subsurface Scattering Parameters , 2006 .

[53]  Richard E. Parent,et al.  Computer animation - algorithms and techniques , 2012 .

[54]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, SIGGRAPH 2005.

[55]  W Musterle,et al.  Computer faces: the human Lorenz matrix. , 1986, Bio Systems.

[56]  P. Ekman,et al.  Detecting deception from the body or face. , 1974 .

[57]  Sung Yong Shin,et al.  An example-based approach for facial expression cloning , 2003, SCA '03.

[58]  Antonios Danelakis,et al.  A survey on facial expression recognition in 3D video sequences , 2014, Multimedia Tools and Applications.

[59]  P. Ekman.  Expression and the Nature of Emotion , 1984 .

[60]  Michal Haindl,et al.  Bidirectional Texture Functions , 2013 .

[61]  Anika Mahmud,et al.  Dynamic facial appearance capture using six primaries , 2012 .

[62]  Jean Ponce,et al.  Dense 3D motion capture for human faces , 2009, CVPR.

[63]  R. Chellappa,et al.  Markerless Motion Capture using Multiple Cameras , 2005, Computer Vision for Interactive and Intelligent Environment (CVIIE'05).

[64]  William A. P. Smith,et al.  Proceedings of the SSPNET 2nd International Symposium on Facial Analysis and Animation , 2010 .

[65]  Hao Zhou,et al.  3D scan-based animation techniques for Chinese opera facial expression documentation , 2007, Comput. Graph..

[66]  Steve DiPaola,et al.  Exploring a parameterised portrait painting space , 2009, Int. J. Arts Technol..

[67]  Craig Donner,et al.  Light diffusion in multi-layered translucent materials , 2005, SIGGRAPH 2005.

[68]  P. Johnson-Laird,et al.  The language of emotions: An analysis of a semantic field , 2013 .

[69]  So-Yeon Yoon,et al.  Reading Emotion of Color Environments: Computer Simulations with Self-Reports and Physiological Signals , 2014 .

[70]  George A. Agoston.  Color theory and its application in art and design , 1979 .

[71]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[72]  Chen Liu,et al.  AN ANALYSIS OF THE CURRENT AND FUTURE STATE OF 3D FACIAL ANIMATION TECHNIQUES AND SYSTEMS , 2009 .

[73]  P. Johnson-Laird,et al.  Cognitive approaches to emotions , 2014, Trends in Cognitive Sciences.

[74]  Karl vom Berge,et al.  A compact factored representation of heterogeneous subsurface scattering , 2006, SIGGRAPH 2006.

[75]  Masood Mehmood Khan,et al.  Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature , 2009, TAP.

[76]  Tony Ezzat,et al.  MikeTalk: a talking facial display based on morphing visemes , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[77]  Ahmad Hoirul Basori,et al.  Extreme expression of sweating in 3D virtual human , 2014, Comput. Hum. Behav..