SUMLOW: early design‐stage sketching of UML diagrams on an E‐whiteboard

Most visual diagramming tools provide point‐and‐click construction of computer‐drawn diagram elements using a conventional desktop computer and mouse. SUMLOW is a unified modelling language (UML) diagramming tool that uses an electronic whiteboard (E‐whiteboard) and sketching‐based user interface to support collaborative software design. SUMLOW allows designers to sketch UML constructs, mixing different UML diagram elements, diagram annotations, and hand‐drawn text. A key novelty of the tool is the preservation of hand‐drawn diagrams and support for manipulation of these sketches using pen‐based actions. Sketched diagrams can be automatically ‘formalized’ into computer‐recognized and ‐drawn UML diagrams and then exported to a third party CASE tool for further extension and use. We describe the motivation for SUMLOW, illustrate the use of the tool to sketch various UML diagram types, describe its key architecture abstractions and implementation approaches, and report on two evaluations of the toolset. We hope that our experiences will be useful for others developing sketching‐based design tools or those looking to leverage pen‐based interfaces in software applications. Copyright © 2007 John Wiley & Sons, Ltd.

[1]  T.F. Stahovich.  The Engineering Sketch , 1998, IEEE Intelligent Systems and their Applications.

[2]  William E. Weihl,et al.  A Case Study Of CES: A Distributed Collaborative Editing System Implemented In Argus , 1992, IEEE Trans. Software Eng..

[3]  A. Richard Newton,et al.  Robust sketched symbol fragmentation using templates , 2004, IUI '04.

[4]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[5]  Louise Scott,et al.  Issues in software engineering tool construction , 2000, Inf. Softw. Technol..

[6]  Alastair F. Donaldson,et al.  Pen-based Input of UML Activity Diagrams for Business Process Modelling , 2005 .

[7]  Gabriela Goldschmidt.  Serial sketching: visual problem solving in designing , 1992 .

[8]  Rob Miller,et al.  The Amulet Environment: New Models for Effective User Interface Software Development , 1997, IEEE Trans. Software Eng..

[9]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[10]  Beryl Plimmer,et al.  Computer-Aided Sketching to Capture Preliminary Design , 2002, AUIC.

[11]  Alan F. Blackwell,et al.  First steps in programming: a rationale for attention investment models , 2002, Proceedings IEEE 2002 Symposia on Human Centric Computing Languages and Environments.

[12]  Yin Yin Wong.  Rough and ready prototypes: lessons from graphic design , 1992, CHI '92.

[13]  Andrew Brooks,et al.  Constraints in CASE tools: results from curiosity driven research , 2001, Proceedings 2001 Australian Software Engineering Conference.

[14]  Randall Davis,et al.  Tahuti: a geometrical sketch recognition system for UML class diagrams , 2006, SIGGRAPH Courses.

[15]  James A. Landay,et al.  SILK: sketching interfaces like krazy , 1996, CHI Conference Companion.

[16]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[17]  Kendall Scott,et al.  UML distilled - a brief guide to the Standard Object Modeling Language (2. ed.) , 2000, notThenot Addison-Wesley object technology series.

[18]  Mark W. Newman,et al.  DENIM: finding a tighter fit between tools and practice for Web site design , 2000, CHI.

[19]  Edward Lank,et al.  On-line recognition of UML diagrams , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[20]  Ravishankar K. Iyer,et al.  Experimental evaluation , 1995 .

[21]  V. Goel.  Sketches of thought , 1995 .

[22]  John C. Grundy,et al.  An e-whiteboard application to support early design-stage sketching of UML diagrams , 2003, IEEE Symposium on Human Centric Computing Languages and Environments, 2003. Proceedings. 2003.

[23]  Juhani Iivari,et al.  Why are CASE tools not used? , 1996, CACM.

[24]  Takayuki Dan Kimura,et al.  Recognizing multistroke geometric shapes: an experimental evaluation , 1993, UIST '93.

[25]  Alison Black.  Visible planning on paper and on screen: The impact of working medium on decision-making by novice graphic designers , 1990 .

[26]  Jason E. Robbins,et al.  Cognitive support, UML adherence, and XMI interchange in Argo/UML , 2000, Inf. Softw. Technol..

[27]  Christian Heide Damm,et al.  Tool support for cooperative object-oriented design: gesture based modelling on an electronic whiteboard , 2000, CHI.

[28]  John C. Grundy,et al.  Engineering plug‐in software components to support collaborative work , 2002, Softw. Pract. Exp..

[29]  A. Newton,et al.  Sketched symbol recognition using Zernike moments , 2004, ICPR 2004.

[30]  Jörg M. Haake,et al.  Designing object-oriented synchronous groupware with COAST , 1996, CSCW '96.

[31]  Terry Quatrani,et al.  Visual Modeling with Rational Rose 2002 and UML , 2002 .

[32]  Dave A. Berque,et al.  Teaching theory of computation using pen-based computers and an electronic whiteboard , 2001, ITiCSE.

[33]  Blair MacIntyre,et al.  Integrating virtual and physical context to support knowledge workers , 2002, IEEE Pervasive Computing.

[34]  James Noble,et al.  A Lightweight Web-Based Case Tool for UML Class Diagrams , 2003, AUIC.