A Multilingual Sketch-Based Sudoku Game with Real-Time Recognition

Sudoku is one of the most popular puzzles of all time: easy to understand but still very challenging, Sudoku continues to captivate players all over the world through newspapers, puzzle books, and digital devices. The application introduced in this work is a multilingual, sketch-based version of the Sudoku game. Sketch input renders more flexibility to users and increases usability. Multilingual support paired with sketching allows the game to serve as an educational tool for those learning a new language, with the current implementation supporting Chinese and Hindi. The recognition algorithm proposed in this work, based on the Hausdorff metric, easily enables extending the application to support other languages. Preliminary results indicate an overall accuracy of over 93% when recognizing Chinese and Hindi numbers at the same time.

[1]  Tracy Anne Hammond,et al.  Using a Geometric-Based Sketch Recognition Approach to Sketch Chinese Radicals , 2008, AAAI.

[2]  Tracy Hammond,et al.  Urdu Qaeda: Recognition System for Isolated Urdu Characters , 2009 .

[3]  Martin Field,et al.  Sketch Recognition Algorithms for Comparing Complex and Unpredictable Shapes , 2011, IJCAI.

[4]  Tracy Anne Hammond,et al.  Perceptually-based language to simplify sketch recognition user interface development , 2007 .

[5]  H. Harlow,et al.  Learning motivated by a manipulation drive. , 1950, Journal of experimental psychology.

[6]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[7]  Brian Eoff,et al.  Sketch-based educational games: "drawing" kids away from traditional interfaces , 2008, IDC.

[8]  Maria Virvou,et al.  Combining Software Games with Education: Evaluation of its Educational Effectiveness , 2005, J. Educ. Technol. Soc..

[9]  Pablo Moreno-Ger,et al.  : Introducing educational games in the learning process , 2010, IEEE EDUCON 2010 Conference.

[10]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[12]  Tracy Anne Hammond,et al.  An Intelligent Sketch-Based Educational Interface for Learning Complex Written East Asian Phonetic Symbols , 2016, Revolutionizing Education with Digital Ink.

[13]  Levent Burak Kara,et al.  An image-based, trainable symbol recognizer for hand-drawn sketches , 2005, Comput. Graph..

[14]  Faruq A. Al-Omari.  Handwritten Indian numeral recognition system using template matching approaches , 2001, Proceedings ACS/IEEE International Conference on Computer Systems and Applications.

[15]  Tracy Anne Hammond,et al.  A Geometric-based Sketch Recognition Approach for Handwritten Mandarin Phonetic Symbols I , 2008, DMS.

[16]  Tracy Anne Hammond,et al.  Recognizing sketched multistroke primitives , 2011, ACM Trans. Interact. Intell. Syst..

[17]  Brian Eoff,et al.  ShortStraw: a simple and effective corner finder for polylines , 2008, SBM'08.

[18]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[19]  Matthew B. Blaschko,et al.  On Hausdorff Distance Measures , 2004 .

[20]  John Sweller,et al.  Cognitive technology: Some procedures for facilitating learning and problem solving in mathematics and science. , 1989 .

[21]  Glenn A. Iba,et al.  Learning by Discovering Macros in Puzzle Solving , 1985, IJCAI.

[22]  Paul Taele,et al.  Enhancing Instruction of Written East Asian Languages with Sketch Recognition-Based “Intelligent Language Workbook” Interfaces , 2015 .

[23]  Yoshua Bengio,et al.  No Unbiased Estimator of the Variance of K-Fold Cross-Validation , 2003, J. Mach. Learn. Res..

[24]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..