Supporting creative work tasks: the potential of multimodal tools to support sketching

Our research goal was to investigate, theoretically and empirically, the nature of creative work tasks, in particular sketching, with the aim of providing computer tool support. The domain investigated was character development in animation and illustration. The empirical studies into sketching, along with literature sources, provided the basis for a set of requirements for a multimodal tool to be designed to support the sketching task. The multimodal system included voice input and radial marking menus in an effort to support the need for rapid access to system functionality, and to avoid screen clutter. Informal evaluations were conducted which provided qualitative feedback about the use of the system.

[1]  Ellen Yi-Luen Do,et al.  Drawing as a Means to Design Reasoning , 1996 .

[2]  Donald A. Schön.  Designing as reflective conversation with the materials of a design situation , 1992, Knowl. Based Syst..

[3]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[4]  M. Weiser,et al.  An empirical comparison of pie vs. linear menus , 1988, CHI '88.

[5]  Rivka Oxman,et al.  Design by re-representation: a model of visual reasoning in design , 1997 .

[6]  Alex Waibel,et al.  A multimodal human-computer interface: combination of speech and gesture recognition , 1996 .

[7]  Alexander G. Hauptmann,et al.  Speech and gestures for graphic image manipulation , 1989, CHI '89.

[8]  Philip R. Cohen.  The role of natural language in a multimodal interface , 1992, UIST '92.

[9]  James H. Garrett,et al.  CAD usage in an architectural office: from observations to active assistance , 1996 .

[10]  Sharon L. Oviatt,et al.  Multimodal interfaces for dynamic interactive maps , 1996, CHI.

[11]  Abigail Sellen,et al.  An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus , 1993, Hum. Comput. Interact..

[12]  G. Goldschmidt.  The dialectics of sketching , 1991 .

[13]  Bryan Lawson,et al.  How Designers Think: The Design Process Demystified , 1990 .

[14]  Mark D. Gross,et al.  The Electronic Cocktail Napkin—a computational environment for working with design diagrams , 1996 .

[15]  M. Boden.  The creative mind : myths & mechanisms , 1991 .

[16]  Philip J. Barnard,et al.  Representing Cognitive Activity in Complex Tasks , 1999, Hum. Comput. Interact..

[17]  Masaki Suwa,et al.  What do architects and students perceive in their design sketches? A protocol analysis , 1997 .

[18]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[19]  H. Johnson,et al.  Task knowledge structures: Psychological basis and integration into system design ☆ , 1991 .