Intelligent understanding of handwritten geometry theorem proving

Computer-based geometry systems have been widely used for teaching and learning, but largely based on mouse-and-keyboard interaction, these systems usually require users to draw figures by following strict task structures defined by menus, buttons, and mouse and keyboard actions. Pen-based designs offer a more natural way to develop geometry theorem proofs with hand-drawn figures and scripts. This paper describes a pen-based geometry theorem proving system that can effectively recognize hand-drawn figures and hand-written proof scripts, and accurately establish the correspondence between geometric components and proof steps. Our system provides dynamic and intelligent visual assistance to help users understand the process of proving and allows users to manipulate geometric components and proof scripts based on structures rather than strokes. The results from evaluation study show that our system is well perceived and users have high satisfaction with the accuracy of sketch recognition, the effectiveness of visual hints, and the efficiency of structure-based manipulation.

[1]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[2]  K. Ishigaki,et al.  Hybrid pen-input character recognition system based on integration of online-offline recognition , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[3]  Xiao-Shan Gao,et al.  Automated generation of readable proofs with geometric invariants , 2004, Journal of Automated Reasoning.

[4]  Wing-Kwong Wong,et al.  A dynamic geometry environment for learning theorem proving , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[5]  Guozhong Dai,et al.  Sketch recognition with continuous feedback based on incremental intention extraction , 2005, IUI.

[6]  Stephen M. Watt,et al.  Hybrid Mathematical Symbol Recognition Using Support Vector Machines , 2007 .

[7]  Guozhong Dai,et al.  Structuralizing digital ink for efficient selection , 2006, IUI '06.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Xiao-Shan Gao,et al.  MMP/Geometer - A Software Package for Automated Geometric Reasoning , 2002, Automated Deduction in Geometry.

[10]  John Hart,et al.  ACM Transactions on Graphics: Editorial , 2003, SIGGRAPH 2003.

[11]  John R. Anderson,et al.  The Geometry Tutor , 1985, IJCAI.

[12]  Levent Burak Kara,et al.  Automatic parsing and recognition of hand-drawn sketches for pen-based computer interfaces , 2004 .

[13]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, ACM Trans. Graph..

[14]  Ulrich Kortenkamp USING AUTOMATIC THEOREM PROVING TO IMPROVE THE USABILITY OF GEOMETRY SOFTWARE , 2004 .

[15]  Julien Narboux,et al.  A Graphical User Interface for Formal Proofs in Geometry , 2007, Journal of Automated Reasoning.

[16]  Thomas H. Cormen,et al.  Introduction to algorithms [2nd ed.] , 2001 .

[17]  Randall Davis,et al.  Recognition of Hand Drawn Chemical Diagrams , 2007, AAAI.

[18]  Xin Wang,et al.  The Understanding and Structure Analyzing for Online Handwritten Chemical Formulas , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[19]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[20]  S. Senk How Well Do Students Write Geometry Proofs , 1985 .

[21]  Guozhong Dai,et al.  PIGP: A Pen-Based Intelligent Dynamic Lecture System for Geometry Teaching , 2007, Edutainment.

[22]  Christine Alvarado,et al.  Resolving ambiguities to create a natural computer-based sketching environment , 2007, SIGGRAPH '07.

[23]  D. Chazan High school geometry students' justification for their views of empirical evidence and mathematical proof , 1993 .

[24]  E. Knuth Teachers' Conceptions of Proof in the Context of Secondary School Mathematics , 2002 .

[25]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[26]  Hongan Wang,et al.  Structuring and manipulating hand-drawn concept maps , 2010, 2010 4th International Universal Communication Symposium.