Current standard interfaces for entering mathematical equations on computers are arguably limited and cumbersome. Mathematics notations have evolved to aid visual thinking and yet text-based interfaces relying on keyboard-and-mouse input do not take advantage of the natural two-dimensional aspects of math. Due to its similarities to paper-based mathematics, pen-based handwriting input may be faster, more efficient, and more preferable for entering mathematics on computers. This paper presents an empirical study that tests this hypothesis. We also explored a multimodal input method combining handwriting and speech because we hypothesize that it may enhance computer recognition and aid user cognition. Novice users were indeed faster, more efficient and enjoyed the handwriting modality more than a standard keyboard-and-mouse mathematics interface, especially as equation length and complexity increased. The multimodal handwriting-plus-speech method was faster and better liked than the keyboard-and-mouse method and was not much worse than handwriting alone.
[1]
C. Marlin “Lin” Brown.
Comparison of Typing and Handwriting in “Two-Finger Typists”
,
1988
.
[2]
J. Locke,et al.
Subvocalization of heard or seen words prior to spoken or written recall.
,
1972,
The American journal of psychology.
[3]
Sharon L. Oviatt,et al.
Mutual disambiguation of recognition errors in a multimodel architecture
,
1999,
CHI '99.
[4]
James Arvo,et al.
Equation entry and editing via handwriting and gesture recognition
,
2001,
Behav. Inf. Technol..
[5]
John R. Anderson,et al.
Cognitive Tutors: Lessons Learned
,
1995
.
[6]
John Sweller,et al.
Cognitive Load During Problem Solving: Effects on Learning
,
1988,
Cogn. Sci..
[7]
Dorothea Blostein,et al.
RECOGNITION OF MATHEMATICAL NOTATION
,
1997
.