Handwritten CAPTCHA: using the difference in the abilities of humans and machines in reading handwritten words

Handwritten text offers challenges that are rarely encountered in machine-printed text. In addition, most problems faced in reading machine-printed text (e.g., character recognition, word segmentation, letter segmentation, etc.) are more severe, in handwritten text. In this paper we present the application of human interactive proofs (HIP), which is a relatively new research area with the primary focus of defending online services against abusive attacks. It uses a set of security protocols based on automatic tests that humans can pass but the state-of-the-art computer programs cannot. This is accomplished by exploiting the differential in the proficiency between humans and computers in reading handwritten word images.

[1]  Manuel Blum,et al.  Telling Humans and Computers Apart Automatically or How Lazy Cryptographers do AI , 2002 .

[2]  Yong Zhu,et al.  Mandatory human participation: a new authentication scheme for building secure systems , 2003, Proceedings. 12th International Conference on Computer Communications and Networks (IEEE Cat. No.03EX712).

[3]  Sargur N. Srihari,et al.  Integration of hand-written address interpretation technology into the United States Postal Service Remote Computer Reader system , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[4]  Venu Govindaraju,et al.  A Stochastic Model Combining Discrete Symbols and Continuous Attributes and Its Application to Handwriting Recognition , 2002, Document Analysis Systems.

[5]  Anthony J. Robinson,et al.  An Off-Line Cursive Handwriting Recognition System , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Horst Bunke,et al.  Automatic bankcheck processing , 1997 .

[7]  Fumitaka Kimura,et al.  Handwritten word recognition using lexicon free and lexicon directed word recognition algorithms , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[8]  Venu Govindaraju,et al.  The Role of Holistic Paradigms in Handwritten Word Recognition , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Daniel P. Lopresti,et al.  A reverse turing test using speech , 2002, INTERSPEECH.

[10]  Sargur N. Srihari,et al.  Decision Combination in Multiple Classifier Systems , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Henry S. Baird,et al.  BaffleText: a Human Interactive Proof , 2003, IS&T/SPIE Electronic Imaging.

[12]  Venu Govindaraju,et al.  On the Dependence of Handwritten Word Recognizers on Lexicons , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Venu Govindaraju,et al.  Reading handwritten US census forms , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[14]  G. Saon,et al.  Off-line handwritten word recognition using a mixed HMM-MRF approach , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[15]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[16]  George Nagy,et al.  Optical character recognition: an illustrated guide to the frontier , 1999, Electronic Imaging.

[17]  Seong-Whan Lee,et al.  An HMMRF-based statistical approach for off-line handwritten character recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[18]  Zicheng Liu,et al.  ARTiFACIAL: automated reverse turing test using FACIAL features , 2003, MULTIMEDIA '03.

[19]  Henry S. Baird,et al.  Pessimal print: a reverse Turing test , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[20]  Kris Popat,et al.  Human Interactive Proofs and Document Image Analysis , 2002, Document Analysis Systems.

[21]  Venu Govindaraju,et al.  Use of Lexicon Density in Evaluating Word Recognizers , 2000, Multiple Classifier Systems.

[22]  Gyeonghwan Kim,et al.  A Lexicon Driven Approach to Handwritten Word Recognition for Real-Time Applications , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Sargur N. Srihari,et al.  A hypothesis testing approach to word recognition using dynamic feature selection , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[24]  Jitendra Malik,et al.  Recognizing objects in adversarial clutter: breaking a visual CAPTCHA , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..