User Interfaces for On-Line Diagram Recognition

The user interface is critical to the success of a diagram recognition system. It is difficult to define precise goals for a user interface, and even more difficult to quantify performance of a user interface. In this paper, we discuss some of the many research questions related to user interfaces in diagram recognition systems. We relate experiences we have gathered during the construction of two on-line diagram recognition systems, one for UML (Unified Modeling Language) notation and the other for mathematical notation. The goal of this paper is to encourage discussion. The graphics recognition community needs strategies and criteria for designing, implementing, and evaluating user interfaces.

[1]  Christian Heide Damm,et al.  Tool support for cooperative object-oriented design: gesture based modelling on an electronic whiteboard , 2000, CHI.

[2]  Joanna McGrenere,et al.  Affordances: Clarifying and Evolving a Concep , 2000, Graphics Interface.

[3]  James A. Landay,et al.  Visual similarity of pen gestures , 2000, CHI.

[4]  Kenneth P. Brooks,et al.  Lilac: a two-view document editor , 1991, Computer.

[5]  Bradley T. Vander Zanden,et al.  An empirical study of constraint usage in graphical applications , 1996, UIST '96.

[6]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[7]  Jakob Nielsen,et al.  Measuring usability: preference vs. performance , 1994, CACM.

[8]  Richard Zanibbi,et al.  Baseline structure analysis of handwritten mathematics notation , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[9]  Lippold Haken,et al.  The lime music editor: A diagram editor involving complex translations , 1994, Softw. Pract. Exp..

[10]  Jennifer Mankoff,et al.  Providing integrated toolkit-level support for ambiguity in recognition-based interfaces , 2000, CHI Extended Abstracts.

[11]  Edward Lank,et al.  On-line recognition of UML diagrams , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[12]  Marc H. Brown,et al.  Zeus: a system for algorithm animation and multi-view editing , 1991, Proceedings 1991 IEEE Workshop on Visual Languages.

[13]  Brad A. Myers,et al.  User interface software tools , 1995, TCHI.

[14]  Masaki Nakagawa,et al.  Lazy recognition as a principle of pen interfaces , 1993, INTERCHI Adjunct Proceedings.

[15]  James Arvo,et al.  A Handwritting-Based Equation Editor , 1999, Graphics Interface.

[16]  James Arvo,et al.  Aiding Manipulation of Handwritten Mathematical Expressions through Style-Preserving Morphs , 2001, Graphics Interface.

[17]  Richard C. Hsu,et al.  After 400 years, print is still superior , 1997, CACM.

[18]  William H. Cushman,et al.  Usable OCR: what are the minimum performance requirements? , 1990, CHI '90.

[19]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[20]  T.M. Duffy,et al.  Scenario-Based Design: Envisioning Work and Technology in System Development [Book Review] , 1996, IEEE Transactions on Professional Communication.

[21]  John C. Tang,et al.  VideoWhiteboard: video shadows to support remote collaboration , 1991, CHI.

[22]  Ihsin T. Phillips,et al.  Empirical Performance Evaluation of Graphics Recognition Systems , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Joanna McGrenere,et al.  Affordances: Clarifying and Evolving a Concep , 2000, Graphics Interface.

[24]  Lippold Haken,et al.  Using Diagram Generation Software to Improve Diagram Recognition: A Case Study of Music Notation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  James Arvo,et al.  A Synthesis of Recognition and Morphing , 2000 .

[26]  Luc E. Julia,et al.  Pattern recognition and beautification for a pen based interface , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[27]  Joëlle Coutaz,et al.  A dimension space for the design of interactive systems within their physical environments , 2000, DIS '00.

[28]  Gary E. Kopec,et al.  Editing images of text , 1994, CACM.