Freehand Sketch Recognition for Computer-Assisted Language Learning of Written East Asian Languages

Freehand Sketch Recognition for Computer-Assisted Language Learning of Written East Asian Languages. (December 2010) Paul Piula Taele, B.S., The University of Texas at Austin Chair of Advisory Committee: Dr. Tracy Hammond One of the challenges students face in studying an East Asian (EA) language (e.g., Chinese, Japanese, and Korean) as a second language is mastering their selected language’s written component. This is especially true for students with native fluency of English and deficient written fluency of another EA language. In order to alleviate the steep learning curve inherent in the properties of EA languages’ complicated writing scripts, language instructors conventionally introduce various written techniques such as stroke order and direction to allow students to study writing scripts in a systematic fashion. Yet, despite the advantages gained from written technique instruction, the physical presence of the language instructor in conventional instruction is still highly desirable during the learning process; not only does it allow instructors to offer valuable real-time critique and feedback interaction on students’ writings, but it also allows instructors to correct students’ bad writing habits that would impede mastery of the written language if not caught early in the learning process. The current generation of computer-assisted language learning (CALL) applications specific to written EA languages have therefore strived to incorporate writing-capable modalities in order to allow students to emulate their studies outside the

[1]  Koun-Tem Sun,et al.  A Distance Learning System for Teaching the Writing of Chinese Characters over the Internet , 2004, Int. J. Distance Educ. Technol..

[2]  Masaki Nakagawa,et al.  HANDWRITING-BASED USER INTERFACES EMPLOYING ON-LINE HANDWRITING RECOGNITION , 1999 .

[3]  Yin Ming,et al.  Kanji learning system based on the letter shape recognition method , 2002, International Conference on Computers in Education, 2002. Proceedings..

[4]  James A. Pittman,et al.  Handwriting Recognition: Tablet PC Text Input , 2007, Computer.

[5]  Andries van Dam,et al.  Next-generation educational software: why we need it & a research agenda for getting it , 2007, SIGGRAPH Courses.

[6]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[7]  坂野 永理,et al.  初級日本語げんき = An integrated course in elementary Japanese , 1999 .

[8]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[9]  Ken Lunde CJKV Information Processing: Chinese, Japanese, Korean & Vietnamese Computing , 1999 .

[10]  Guey-Shya Chen,et al.  Stroke order computer-based assessment with fuzzy measure scoring , 2008 .

[11]  John Defrancis The Chinese Language: Fact and Fantasy , 1986 .

[12]  Heng-Nian Qi A Size-independent method for Chinese character writing structure assessment , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[13]  Cheryl L. Willis,et al.  Tablet PC's as instructional tools or the pen is mightier than the 'board! , 2004, CITC5 '04.

[14]  Qiang Huo,et al.  A Study of Feature Design for Online Handwritten Chinese Character Recognition Based on Continuous-Density Hidden Markov Models , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[15]  Thomas F. Stahovich,et al.  Sketch based interfaces: early processing for sketch understanding , 2001, PUI '01.

[16]  Tracy Anne Hammond,et al.  LAMPS: A sketch recognition-based teaching tool for Mandarin Phonetic Symbols I , 2010, J. Vis. Lang. Comput..

[17]  Yuan-Yuan Yang,et al.  Adaptive recognition of Chinese characters: imitation of psychological process in machine recognition , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[18]  A. Robinson I. Introduction , 1991 .

[19]  Jing Xu,et al.  Chinese Character Recognition Method Based on Multi-features and Parallel Neural Network Computation , 2007, ICIC.

[20]  Shek Kam Tse,et al.  Computer-assisted-learning for learning Chinese characters , 1993 .

[21]  Kenji Mase,et al.  A multi-modal mobile device for learning japanese kanji characters through mnemonic stories , 2007, ICMI '07.

[22]  Matthew Kam,et al.  Let's play chinese characters: mobile learning approaches via culturally inspired group games , 2010, CHI.

[23]  Masaki Nakagawa,et al.  'Online recognition of Chinese characters: the state-of-the-art , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Dzulkifli Mohamad,et al.  On-line Handwritten Character Recognition: AnImplementation of Counterpropagation Neural Net , 2005 .

[25]  James W. Heisig A complete course on how not to forget the meaning and writing of Japanese characters , 1977 .

[26]  Guey-Shya Chen,et al.  Computer-based Assessment for the Stroke Order of Chinese Characters Writing , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).