SketchWizard: Wizard of Oz prototyping of pen-based user interfaces

SketchWizard allows designers to create Wizard of Oz prototypes of pen-based user interfaces in the early stages of design. In the past, designers have been inhibited from participating in the design of pen-based interfaces because of the inadequacy of paper prototypes and the difficulty of developing functional prototypes. In SketchWizard, designers and end users share a drawing canvas between two computers, allowing the designer to simulate the behavior of recognition or other technologies. Special editing features are provided to help designers respond quickly to end-user input. This paper describes the SketchWizard system and presents two evaluations of our approach. The first is an early feasibility study in which Wizard of Oz was used to prototype a pen-based user interface. The second is a laboratory study in which designers used SketchWizard to simulate existing pen-based interfaces. Both showed that end users gave valuable feedback in spite of delays between end-user actions and wizard updates.

[1]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[2]  J. F. Kelley,et al.  An iterative design methodology for user-friendly natural language office information applications , 1984, TOIS.

[3]  Blair MacIntyre,et al.  Wizard of Oz support throughout an iterative design process , 2005, IEEE Pervasive Computing.

[4]  Joëlle Coutaz,et al.  Towards automatic evaluation of multimodal user interfaces , 1993, Knowl. Based Syst..

[5]  Jay David Bolter,et al.  Alice's Adventure's in New Media: An Exploration of Interactive Narratives in Augmented Reality , 2001 .

[6]  Lennart Molin,et al.  Wizard-of-Oz prototyping for co-operative interaction design of graphical user interfaces , 2004, NordiCHI '04.

[7]  Yang Li,et al.  Topiary: a tool for prototyping location-enhanced applications , 2004, UIST '04.

[8]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[9]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[10]  Saul Greenberg,et al.  Prototyping an intelligent agent through Wizard of Oz , 1993, INTERCHI.

[11]  David Akers,et al.  CINCH: a cooperatively designed marking interface for 3D pathway selection , 2006, UIST.

[12]  James A. Landay,et al.  Informal Animation Sketching: Requirements and Design , 2004, AAAI Technical Report.

[13]  Jay David Bolter,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, SIGGRAPH 2005.

[14]  Yang Li,et al.  BrickRoad: a light-weight tool for spontaneous design of location-enhanced applications , 2007, CHI.

[15]  Richard J. Anderson,et al.  A study of digital ink in lecture presentation , 2004, CHI.

[16]  Clayton Lewis,et al.  Designing for usability—key principles and what designers think , 1983, CHI '83.

[17]  Claudio S. Pinhanez,et al.  A study on the manipulation of 2D objects in a projector/camera-based augmented reality environment , 2005, CHI.

[18]  Thomas P. Moran,et al.  Implicit structure for pen-based systems within a freeform interaction paradigm , 1995, CHI '95.

[19]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[20]  Xiangshi Ren,et al.  Structuralizing Freeform Notes by Implicit Sketch Understanding , 2002 .

[21]  Anoop K. Sinha,et al.  Multimodal theater: extending low fidelity paper prototyping to multimodal applications , 2002, CHI Extended Abstracts.

[22]  Lionel Médini,et al.  Reinventing the familiar: exploring an augmented reality design space for air traffic control , 1998, CHI.

[23]  Gregory D. Abowd,et al.  Providing integrated toolkit-level support for ambiguity in recognition-based interfaces , 2000, CHI.

[24]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, ACM Trans. Graph..

[25]  Yang Li,et al.  Design Challenges and Principles for Wizard of Oz Testing of Location-Enhanced Applications , 2007, IEEE Pervasive Computing.

[26]  David Jones,et al.  Discerning structure from freeform handwritten notes , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[27]  Marc Rettig,et al.  Prototyping for tiny fingers , 1994, CACM.

[28]  William Buxton,et al.  User learning and performance with marking menus , 1994, CHI 1994.

[29]  Brian P. Bailey,et al.  Are informal tools better?: comparing DEMAIS, pencil and paper, and authorware for early multimedia design , 2003, CHI '03.

[30]  Anoop K. Sinha,et al.  Capturing user tests in a multimodal, multidevice informal prototyping tool , 2003, ICMI '03.

[31]  Takeo Igarashi,et al.  An architecture for pen-based interaction on electronic whiteboards , 2000, AVI '00.

[32]  Mark W. Newman,et al.  DENIM: An Informal Web Site Design Tool Inspired by Observations of Practice , 2003, Hum. Comput. Interact..

[33]  Anoop K. Sinha,et al.  Suede: a Wizard of Oz prototyping tool for speech user interfaces , 2000, UIST '00.

[34]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[35]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[36]  Carolyn Snyder,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2003 .