Interactive prototyping of tabletop and surface applications

Physically large touch-based devices, such as tabletops, afford numerous innovative interaction possibilities; however, for application development on these devices to be successful, users must be presented with interactions they find natural and easy to learn. User-centered design advocates the use of prototyping to help designers create software that is a better fit with user needs and yet, due to time pressures or inappropriate tool support, prototyping may be considered too costly to do. To address these concerns, we designed ProtoActive, a tool for designing and evaluating multi-touch applications on large surfaces via sketch-based prototypes. Our tool allows designers to define custom gestures and evaluate them without requiring any programming knowledge. The paper presents the results of pilot studies as well as in-the-wild usage of the tool.

[1]  Harald Reiterer,et al.  Can "touch" get annoying? , 2010, ITS '10.

[2]  Frank Maurer,et al.  A domain specific language to define gestures for multi-touch applications , 2010, DSM '10.

[3]  Meredith Ringel Morris,et al.  Understanding users' preferences for surface gestures , 2010, Graphics Interface.

[4]  Tony DeRose,et al.  Proton: multitouch gestures as regular expressions , 2012, CHI.

[5]  Frank Maurer,et al.  Learning gestures for interacting with low-fidelity prototypes , 2012, 2012 First International Workshop on Realizing AI Synergies in Software Engineering (RAISE).

[6]  Suzanne Robertson,et al.  Mastering the Requirements Process (2nd Edition) , 2006 .

[7]  Eva Cerezo,et al.  ToyVision: a toolkit for prototyping tabletop tangible games , 2012, EICS '12.

[8]  Andreas Butz,et al.  Sketch-a-TUI: low cost prototyping of tangible interactions using cardboard and conductive ink , 2012, Tangible and Embedded Interaction.

[9]  Bill Moggridge,et al.  Designing interactions , 2006 .

[10]  Erik Stolterman,et al.  The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas , 2008, TCHI.

[11]  Orit Shaer,et al.  A specification paradigm for the design and implementation of tangible user interfaces , 2009, TCHI.

[12]  Jakob Nielsen,et al.  Gestural interfaces: a step backward in usability , 2010, INTR.

[13]  Brian P. Bailey,et al.  DEMAIS: designing multimedia applications with interactive storyboards , 2001, MULTIMEDIA '01.

[14]  Yvonne Rogers,et al.  Being in the thick of in-the-wild studies: the challenges and insights of researcher participation , 2012, CHI.

[15]  Zeljko Obrenovic,et al.  Sketching interactive systems with sketchify , 2011, TCHI.

[16]  Teddy Seyed,et al.  Low-fidelity prototyping of gesture-based applications , 2011, EICS '11.

[17]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[18]  Guy Pyrzak,et al.  Breaking the fidelity barrier: an examination of our current characterization of prototypes and an example of a mixed-fidelity success , 2006, CHI.

[19]  David Geerts,et al.  Low-Fidelity Prototyping for Multi-Touch Surfaces , 2010 .

[20]  Manfred Tscheligi,et al.  Paper prototyping - what is it good for?: a comparison of paper- and computer-based low-fidelity prototyping , 2003, CHI Extended Abstracts.

[21]  Demetrios Karis,et al.  Usability problem identification using both low- and high-fidelity prototypes , 1996, CHI.

[22]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[23]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[24]  Simone Diniz Junqueira Barbosa,et al.  UISKEI: a sketch-based prototyping tool for defining and evaluating user interface behavior , 2012, AVI.

[25]  K. Krippendorff.  The Semantic Turn: A New Foundation For Design , 2005 .

[26]  Susanne Boll,et al.  SCIVA: designing applications for surface computers , 2011, EICS '11.

[27]  Lisa Anthony,et al.  $N-protractor: a fast and accurate multistroke recognizer , 2012, Graphics Interface.

[28]  Janice Singer,et al.  Studying Software Engineers: Data Collection Techniques for Software Field Studies , 2005, Empirical Software Engineering.

[29]  Larry L. Constantine.  Beyond User-Centered Design and User Experience : Designing for User Performance , 2006 .

[30]  Beryl Plimmer,et al.  RATA: codeless generation of gesture recognizers , 2012, BCS HCI.

[31]  Donald A. Norman,et al.  The Design of Future Things , 2007 .

[32]  Stacey D. Scott,et al.  Exploring automation in digital tabletop board game , 2012, CSCW.

[33]  Anoop K. Sinha,et al.  Capturing user tests in a multimodal, multidevice informal prototyping tool , 2003, ICMI '03.

[34]  Kenneth R. Stern,et al.  Low vs. high-fidelity prototyping debate , 1996, INTR.

[35]  Kent Lyons,et al.  GART: The Gesture and Activity Recognition Toolkit , 2007, HCI.

[36]  Peng Wang,et al.  A gestural interaction design model for multi-touch displays , 2009 .

[37]  M. Sheelagh T. Carpendale,et al.  Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits , 2011, CHI.

[38]  T. C. Nicholas Graham,et al.  Raptor: sketching games with a tabletop computer , 2010, Future Play.