A new method for generic three dimensional human face modelling for emotional bio-robots

Existing 3D human face modelling methods are confronted with difficulties in applying flexible control over all facial features and generating a great number of different face models. The gap between the existing methods and the requirements of emotional bio-robots applications urges the creation of a generic 3D human face model. This thesis focuses on proposing and developing two new methods involved in the research of emotional bio-robots: face detection in complex background images based on skin colour model and establishment of a generic 3D human face model based on NURBS. The contributions of this thesis are: A new skin colour based face detection method has been proposed and developed. The new method consists of skin colour model for skin regions detection and geometric rules for distinguishing faces from detected regions. By comparing to other previous methods, the new method achieved better results of detection rate of 86.15% and detection speed of 0.4-1.2 seconds without any training datasets. A generic 3D human face modelling method is proposed and developed. This generic parametric face model has the abilities of flexible control over all facial features and generating various face models for different applications. It includes: The segmentation of a human face of 21 surface features. These surfaces have 34 boundary curves. This feature-based segmentation enables the independent manipulation of different geometrical regions of human face. The NURBS curve face model and NURBS surface face model. These two models are built up based on cubic NURBS reverse computation. The elements of the curve model and surface model can be manipulated to change the appearances of the models by their parameters which are obtained by NURBS reverse computation. A new 3D human face modelling method has been proposed and implemented based on bi-cubic NURBS through analysing the characteristic features and boundary conditions of NURBS techniques. This model can be manipulated through control points on the NURBS facial features to build any specific face models for any kind of appearances and to simulate dynamic facial expressions for various applications such as emotional bio-robots, aesthetic surgery, films and games, and crime investigation and prevention, etc.

[1]  GE Xin-liang.  Research on Facial Feature Points Extraction in Color Images , 2008 .

[2]  David Salomon,et al.  Curves and surfaces for computer graphics , 2005 .

[3]  Ming Zhang,et al.  Face recognition using artificial neural network group-based adaptive tolerance (GAT) trees , 1996, IEEE Trans. Neural Networks.

[4]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[5]  Ronald Chung,et al.  Determining Both Surface Position and Orientation in Structured-Light-Based Sensing , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Thomas Vetter,et al.  Estimating Coloured 3D Face Models from Single Images: An Example Based Approach , 1998, ECCV.

[7]  Brian C. Lovell,et al.  Towards robust face recognition for Intelligent-CCTV based surveillance using one gallery image , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[8]  Renaud Seguier.  A very fast adaptative face detection system , 2004 .

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Qingming Zhan,et al.  3D Data Acquisition by Terrestrial Laser Scanning for Protection of Historical Buildings , 2007, 2007 International Conference on Wireless Communications, Networking and Mobile Computing.

[11]  Yin Bac.  MODELING OF FACIAL EXPRESSIONS AND DEGREE OF LIP-ROUNDING USING B■ZIER SURFACE , 1998 .

[12]  Ferdinando Samaria,et al.  Face Segmentation For Identification Using Hidden Markov Models , 1993, BMVC.

[13]  Yoshihiko Takahashi,et al.  Compact robot face with simple mechanical components , 2010, ICCAS 2010.

[14]  Demetri Terzopoulos,et al.  Modelling and animating faces using scanned data , 1991, Comput. Animat. Virtual Worlds.

[15]  A. Senthil Kumar,et al.  Generalized Surface Interpolation for Triangle Meshes with Feature Retention , 2005 .

[16]  S. G. Tyan,et al.  Median Filtering: Deterministic Properties , 1981 .

[17]  Zicheng Liu,et al.  Model-based bundle adjustment with application to face modeling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[19]  C. Shavers,et al.  An SVM-based approach to face detection , 2006, 2006 Proceeding of the Thirty-Eighth Southeastern Symposium on System Theory.

[20]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Kevin Hapeshi,et al.  3D Modelling of Biological Systems for Biomimetics , 2004 .

[22]  Bogdan J. Matuszewski,et al.  3-D facial expression representation using B-spline statistical shape model , 2007 .

[23]  Elliott H. Rose,et al.  Aesthetic facial restoration , 1998 .

[24]  Anil K. Jain,et al.  Goal-Directed Evaluation of Binarization Methods , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Kenneth James Versprille.  Computer-aided design applications of the rational b-spline approximation form. , 1975 .

[26]  Makoto Nagao,et al.  Line extraction and pattern detection in a photograph , 1969, Pattern Recognit..

[27]  Qian Zhang,et al.  A novel method to train support vector machines for solving quadratic programming task , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[28]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[29]  Jun Zhang,et al.  Face detection and tracking in color images using color centroids segmentation , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[30]  Jing Zhang,et al.  A Novel Approach Using PCA and SVM for Face Detection , 2008, 2008 Fourth International Conference on Natural Computation.

[31]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[32]  Hassan Ugail,et al.  A Short Review of Methods for Face Detection and Multifractal Analysis , 2009, 2009 International Conference on CyberWorlds.

[33]  Takeo Kanade,et al.  Rotation Invariant Neural Network-Based Face Detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).