Face Recognition in the Virtual World: Recognizing Avatar Faces

Criminal activity in virtual worlds is becoming a major problem for law enforcement agencies. Forensic investigators are becoming interested in being able to accurately and automatically track people in virtual communities. In this paper a set of algorithms capable of verification and recognition of avatar faces with high degree of accuracy are described. Results of experiments aimed at within-virtual-world avatar authentication and inter-reality-based scenarios of tracking a person between real and virtual worlds are reported. In the FERET-to-Avatar face dataset, where an avatar face was generated from every photo in the FERET database, a COTS FR algorithm achieved a near perfect 99.58% accuracy on 725 subjects. On a dataset of avatars from Second Life, the proposed avatar-to-avatar matching algorithm (which uses a fusion of local structural and appearance descriptors) achieved average true accept rates of (i) 96.33% using manual eye detection, and (ii) 86.5% in a fully automated mode at a false accept rate of 1.0%. A combination of the proposed face matcher and a state-of-the art commercial matcher (FaceVACS) resulted in further improvement on the inter-reality-based scenario.

[1]  Synthetic Biometrics , 2009, Encyclopedia of Biometrics.

[2]  Anil K. Jain,et al.  Matching Forensic Sketches to Mug Shot Photos , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michael J. Lyons,et al.  Avatar creation using automatic face processing , 1998, MULTIMEDIA '98.

[4]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[5]  Bruce A. Draper,et al.  The CSU Face Identification Evaluation System , 2005, Machine Vision and Applications.

[6]  Adrian Perrig,et al.  This copyright notice must be included in the reproduced paper. USENIX acknowledges all trademarks herein. Déjà Vu: A User Study Using Images for Authentication , 2000 .

[7]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Amit R.Sharma,et al.  Face Photo-Sketch Synthesis and Recognition , 2012 .

[9]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  S.N. Yanushkevich,et al.  Developmental Tools - Synthetic Biometrics , 2007, IEEE Computational Intelligence Magazine.

[12]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[13]  Najoua Essoukri Ben Amara,et al.  Artificial human face recognition via Daubechies wavelet transform and SVM , 2011, 2011 16th International Conference on Computer Games (CGAMES).

[14]  Marina L. Gavrilova,et al.  Applying Biometric Principles to Avatar Recognition , 2010, 2010 International Conference on Cyberworlds.

[15]  Roman V. Yampolskiy,et al.  PARAMETERIZED GENERATION OF AVATAR FACE DATASET , 2008 .

[16]  Seiki Inoue,et al.  Avatar Creation using Automatic Face Recognition , 1998 .

[17]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Marina L. Gavrilova,et al.  Evaluation of Face Recognition Algorithms on Avatar Face Datasets , 2011, 2011 International Conference on Cyberworlds.

[19]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Roman V. Yampolskiy,et al.  An improved LBP algorithm for avatar face recognition , 2011, 2011 XXIII International Symposium on Information, Communication and Automation Technologies.