Avatar CAPTCHA: Telling computers and humans apart via face classification

This paper introduces Avatar CAPTCHA, an image based approach to distinguish human users from computer programs (bots). The proposed CAPTCHA asks users to identify avatar faces from a set of 12 grayscale images comprised of a mix of human and avatar faces. Experimental results indicate that it can be solved 62% of the time by human users with an average success time of 24 seconds and a positive user rating of 90%. It is designed to be secure against computer programs (bots). Using brute force attack the success rate for a bot to solve it is 1/4096.

[1]  Kris Gaj,et al.  Face Recognition CAPTCHAs , 2006, Advanced Int'l Conference on Telecommunications and Int'l Conference on Internet and Web Applications and Services (AICT-ICIW'06).

[2]  A.K. Jain,et al.  Webbiometrics: User Verification Via Web Interaction , 2007, 2007 Biometrics Symposium.

[3]  Jettie Hoonhout,et al.  Human System Interaction , 2000 .

[4]  Rida A. Bazzi,et al.  A Captcha Based on the Human Visual Systems Masking Characteristics , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[5]  Eiji Okamoto,et al.  A User Identification System Using Signature Written with Mouse , 1998, ACISP.

[6]  Roman V. Yampolskiy,et al.  Avatar Face Recognition Using Wavelet Transform and Hierarchical Multi-scale LBP , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[7]  Henry S. Baird,et al.  Complex Image Recognition and Web Security , 2006 .

[8]  Xia Wang,et al.  A CAPTCHA Implementation Based on 3D Animation , 2009, 2009 International Conference on Multimedia Information Networking and Security.

[9]  Klaus Mathiak,et al.  Recognition Profile of Emotions in Natural and Virtual Faces , 2008, PloS one.

[10]  Jon Howell,et al.  Asirra: a CAPTCHA that exploits interest-aligned manual image categorization , 2007, CCS '07.

[11]  Sushil Jajodia,et al.  Blog or block: Detecting blog bots through behavioral biometrics , 2013, Comput. Networks.

[12]  Luis von Ahn,et al.  Human computation , 2009, 2009 46th ACM/IEEE Design Automation Conference.

[13]  Chih-Chin Lai,et al.  Digital Image Watermarking Using Discrete Wavelet Transform and Singular Value Decomposition , 2010, IEEE Transactions on Instrumentation and Measurement.

[14]  Henry S. Baird,et al.  PessimalPrint: a reverse Turing test , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[15]  Haifeng Hu,et al.  Variable lighting face recognition using discrete wavelet transform , 2011, Pattern Recognit. Lett..

[16]  Sajad Shirali-Shahreza,et al.  Online Collage CAPTCHA , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[17]  Vicki L. Hanson,et al.  Exploring Visual and Motor Accessibility in Navigating a Virtual World , 2009, TACC.

[18]  John Langford,et al.  Telling humans and computers apart automatically , 2004, CACM.

[19]  Jeff Yan,et al.  Breaking Visual CAPTCHAs with Naive Pattern Recognition Algorithms , 2007, Twenty-Third Annual Computer Security Applications Conference (ACSAC 2007).

[20]  Pritee Khanna,et al.  Gender classification using Radon and Wavelet Transforms , 2010, 2010 5th International Conference on Industrial and Information Systems.

[21]  Jeff Yan,et al.  A low-cost attack on a Microsoft captcha , 2008, CCS.

[22]  M.H. Shirali Shahreza,et al.  An Anti-SMS-Spam Using CAPTCHA , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[23]  Tae-Cheon Yang,et al.  Execution Time Prediction for 3D Interactive CAPTCHA by Keystroke Level Model , 2009, 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology.

[24]  Zhenyu Wu,et al.  Battle of Botcraft: fighting bots in online games with human observational proofs , 2009, CCS.

[25]  Eric Bruno,et al.  TagCaptcha: annotating images with CAPTCHAs , 2009, HCOMP '09.

[26]  Pawel Lupkowski,et al.  SemCAPTCHA—user-friendly alternative for OCR-based CAPTCHA systems , 2008, 2008 International Multiconference on Computer Science and Information Technology.

[27]  Philippe Golle,et al.  Machine learning attacks against the Asirra CAPTCHA , 2008, CCS.

[28]  Roman V. Yampolskiy,et al.  PARAMETERIZED GENERATION OF AVATAR FACE DATASET , 2008 .

[29]  Dong Chen.  Research of the chinese CAPTCHA system based on AJAX , 2009 .

[30]  T. S. Ravi Kiran,et al.  COMBINING CAPTCHA AND GRAPHICAL PASSWORDS FOR USER AUTHENTICATION , 2012 .

[31]  Richa Singh,et al.  FaceDCAPTCHA: Face detection based color image CAPTCHA , 2014, Future Gener. Comput. Syst..

[32]  Adel Belouchrani,et al.  Fault Diagnosis in Industrial Induction Machines Through Discrete Wavelet Transform , 2011, IEEE Transactions on Industrial Electronics.

[33]  Roman V. Yampolskiy,et al.  Automated Collection of High Quality 3D Avatar Images , 2012, MAICS.

[34]  H. Demirel,et al.  Discrete Wavelet Transform-Based Satellite Image Resolution Enhancement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Henry S. Baird,et al.  BaffleText: a Human Interactive Proof , 2003, IS&T/SPIE Electronic Imaging.

[36]  Youtian Du,et al.  User Authentication Through Mouse Dynamics , 2013, IEEE Transactions on Information Forensics and Security.

[37]  M. Shirali-Shahreza,et al.  Motion CAPTCHA , 2008, 2008 Conference on Human System Interactions.

[38]  Tae-Seong Kim,et al.  Depth video-based gait recognition for smart home using local directional pattern features and hidden Markov model , 2014 .

[39]  Chao Yang,et al.  Attacks and design of image recognition CAPTCHAs , 2010, CCS '10.

[40]  Soumik Mondal,et al.  Continuous authentication using mouse dynamics , 2013, 2013 International Conference of the BIOSIG Special Interest Group (BIOSIG).

[41]  Darryl D'Souza,et al.  Avatar captcha : telling computers and humans apart via face classification and mouse dynamics. , 2014 .

[42]  Venu Govindaraju,et al.  Use of behavioral biometrics in intrusion detection and online gaming , 2006, SPIE Defense + Commercial Sensing.

[43]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[44]  Ashish Jain,et al.  Sequenced picture captcha: generation and its strength analysis , 2009, 2009 International Conference for Internet Technology and Secured Transactions, (ICITST).

[45]  Mary Czerwinski,et al.  Building Segmentation Based Human-Friendly Human Interaction Proofs (HIPs) , 2005, HIP.

[46]  Roman V. Yampolskiy,et al.  Zoo CAPTCHA: Telling Computers and Humans Apart via Animal Image Classification , 2014 .

[47]  Toshihiko Yamasaki,et al.  Face Recognition Challenge: Object Recognition Approaches for Human/Avatar Classification , 2012, 2012 11th International Conference on Machine Learning and Applications.

[48]  Sushma Yalamanchili,et al.  A Framework for Devanagari Script-based Captcha , 2011, ArXiv.

[49]  Brian Cheung,et al.  Convolutional Neural Networks Applied to Human Face Classification , 2012, 2012 11th International Conference on Machine Learning and Applications.

[50]  Mary Czerwinski,et al.  Designing human friendly human interaction proofs (HIPs) , 2005, CHI.

[51]  Gabriel Moy,et al.  Distortion estimation techniques in solving visual CAPTCHAs , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[52]  Rich Gossweiler,et al.  WWW 2009 MADRID! Track: User Interfaces and Mobile Web / Session: User Interfaces What’s Up CAPTCHA? A CAPTCHA Based on Image Orientation , 2022 .

[53]  Jon Louis Bentley,et al.  CAPTCHA Challenge Tradeoffs: Familiarity of Strings versus Degradation of Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[54]  Björn Stenger,et al.  Shape context and chamfer matching in cluttered scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[55]  Henry S. Baird,et al.  ScatterType: a legible but hard-to-segment CAPTCHA , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[56]  Zicheng Liu,et al.  ARTiFACIAL: automated reverse turing test using FACIAL features , 2003, MULTIMEDIA '03.

[57]  Gary Roberts,et al.  Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer , 2008 .

[58]  M. Ponec.  Visual Reverse Turing Tests: A False Sense of Security , 2006, 2006 IEEE Information Assurance Workshop.

[59]  Marion Boberg,et al.  Designing avatars , 2008, DIMEA.

[60]  Sushil Jajodia,et al.  Who is tweeting on Twitter: human, bot, or cyborg? , 2010, ACSAC '10.

[61]  Arturo Ribagorda,et al.  Side-channel attack on the HumanAuth CAPTCHA , 2010, 2010 International Conference on Security and Cryptography (SECRYPT).

[62]  Zhongmin Cai,et al.  Performance evaluation of anomaly-detection algorithms for mouse dynamics , 2014, Comput. Secur..

[63]  Peter W. McOwan,et al.  Java-Based Internet Biometric Authentication System , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Henry S. Baird,et al.  Implicit CAPTCHAs , 2005, DRR.

[65]  Kris Popat,et al.  Human Interactive Proofs and Document Image Analysis , 2002, Document Analysis Systems.

[66]  Venu Govindaraju,et al.  Behavioral biometrics for verification and recognition of malicious software agents , 2008, SPIE Defense + Commercial Sensing.

[67]  J. Doug Tygar,et al.  Image Recognition CAPTCHAs , 2004, ISC.

[68]  John Langford,et al.  CAPTCHA: Using Hard AI Problems for Security , 2003, EUROCRYPT.

[69]  G. Geetha,et al.  CAPTCHA Celebrating its Quattuordecennial - A Complete Reference , 2011 .

[70]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[71]  Ana L. N. Fred,et al.  A behavioral biometric system based on human-computer interaction , 2004, SPIE Defense + Commercial Sensing.

[72]  Ahmed Awad E. Ahmed,et al.  A New Biometric Technology Based on Mouse Dynamics , 2007, IEEE Transactions on Dependable and Secure Computing.

[73]  James Ze Wang,et al.  IMAGINATION: a robust image-based CAPTCHA generation system , 2005, ACM Multimedia.

[74]  Yigitcan Aksari,et al.  Active authentication by mouse movements , 2009, 2009 24th International Symposium on Computer and Information Sciences.

[75]  Muhammad Khurram Khan,et al.  Using Arabic CAPTCHA for Cyber Security , 2010, FGIT-SecTech/DRBC.

[76]  Haining Wang,et al.  An efficient user verification system via mouse movements , 2011, CCS '11.

[77]  Yeuan-Kuen Lee,et al.  A New CAPTCHA Interface Design for Mobile Devices , 2011, AUIC.

[78]  Jiashu Zhang,et al.  Face recognition with enhanced local directional patterns , 2013, Neurocomputing.

[79]  Takumi Yamamoto,et al.  A Proposal of Four-Panel Cartoon CAPTCHA: The Concept , 2010, 2010 13th International Conference on Network-Based Information Systems.

[80]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Ebroul Izquierdo,et al.  Visual word-based CAPTCHA using 3D characters , 2009, ICDP.

[82]  Xia Wang,et al.  A CAPTCHA Implementation Based on Moving Objects Recognition Problem , 2010, 2010 International Conference on E-Business and E-Government.

[83]  Patrick Bours,et al.  A Login System Using Mouse Dynamics , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[84]  Venu Govindaraju,et al.  Behavioural biometrics: a survey and classification , 2008, Int. J. Biom..

[85]  Suphakant Phimoltares,et al.  3D CAPTCHA: A Next Generation of the CAPTCHA , 2010, 2010 International Conference on Information Science and Applications.

[86]  Ian H. Witten,et al.  WEKA: a machine learning workbench , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.

[87]  Patrice Y. Simard,et al.  Using Machine Learning to Break Visual Human Interaction Proofs (HIPs) , 2004, NIPS.

[88]  Liming Wang,et al.  A Novel Image Based CAPTCHA Using Jigsaw Puzzle , 2010, 2010 13th IEEE International Conference on Computational Science and Engineering.

[89]  David J. Crandall,et al.  Learning Visual Features for the Avatar Captcha Recognition Challenge , 2012, 2012 11th International Conference on Machine Learning and Applications.

[90]  Chao Shen,et al.  Continuous authentication for mouse dynamics: A pattern-growth approach , 2012, IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2012).

[91]  Colin L. Mallows,et al.  CAPTCHA challenge strings: problems and improvements , 2006, Electronic Imaging.

[92]  M. Shirali-Shahreza.  Highlighting CAPTCHA , 2008, 2008 Conference on Human System Interactions.

[93]  Carla E. Brodley,et al.  User re-authentication via mouse movements , 2004, VizSEC/DMSEC '04.

[94]  Madasu Hanmandlu,et al.  Local directional pattern (LDP) based fingerprint matching using SLFNN , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[95]  Roman V. Yampolskiy,et al.  Using discrete wavelet transform and eigenfaces for recognizing avatars faces , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[96]  Shivani Hashiaa,et al.  ON USING MOUSE MOVEMENTS AS A BIOMETRIC , 2005 .

[97]  Oksam Chae,et al.  Local Directional Pattern (LDP) – A Robust Image Descriptor for Object Recognition , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[98]  Jitendra Malik,et al.  Recognizing objects in adversarial clutter: breaking a visual CAPTCHA , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[99]  Venu Govindaraju,et al.  Embedded noninteractive continuous bot detection , 2008, CIE.

[100]  M.H. Shirali-Shahreza,et al.  Multilingual CAPTCHA , 2007, 2007 IEEE International Conference on Computational Cybernetics.

[101]  Moni Naor,et al.  VERI CATION OF A HUMAN IN THE LOOP OR IDENTI CATION VIA THE TURING TEST , 1996 .

[102]  K. B. Raja,et al.  Face Recognition System Using Discrete Wavelet Transform and Fast PCA , 2011 .

[103]  Richa Singh,et al.  Face recognition CAPTCHA , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[104]  D.A. Schulz,et al.  Mouse Curve Biometrics , 2006, 2006 Biometrics Symposium: Special Session on Research at the Biometric Consortium Conference.

[105]  Hamid Jahankhani,et al.  A Survey of User Authentication Based on Mouse Dynamics , 2008 .

[106]  Oksam Chae,et al.  Facial expression recognition using Local Directional Pattern (LDP) , 2010, 2010 IEEE International Conference on Image Processing.

[107]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[108]  Roman V. Yampolskiy,et al.  Natural vs Artificial Face Classification Using Uniform Local Directional Patterns and Wavelet Uniform Local Directional Patterns , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[109]  Huan Liu,et al.  Ensemble Feature Selection in Face Recognition: ICMLA 2012 Challenge , 2012, 2012 11th International Conference on Machine Learning and Applications.

[110]  Christophe Garcia,et al.  A Wavelet-based Framework for Face Recognition , 1998 .

[111]  Joonhyuk Yang,et al.  FaceCAPTCHA: a CAPTCHA that identifies the gender of face images unrecognized by existing gender classifiers , 2013, Multimedia Tools and Applications.

[112]  Roman V. Yampolskiy,et al.  Embedded non-interactive CAPTCHA for Fischer Random Chess , 2011, 2011 16th International Conference on Computer Games (CGAMES).