Studying user-defined iPad gestures for interaction in multi-display environment

The paper investigates the iPad gestures that users naturally perform for data transfer. We examine the transfer between two iPads, iPad and a tabletop, and iPad and a public display. Three gesture modalities are investigated: multi-touch gestures, performed using iPad display, spatial gestures, performed by manipulating iPad in 3D space, and direct contact gestures, involving the physical contact of iPad and other device. We report on user choices of the modalities and gesture types, and derive critical points for the design of iPad gestures.

[1]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[2]  Michael Rohs,et al.  User-defined gestures for connecting mobile phones, public displays, and tabletops , 2010, Mobile HCI.

[3]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[4]  Ki-Won Yeom,et al.  Gesture-Based Interface for Connection and Control of Multi-device in a Tabletop Display Environment , 2009, HCI.

[5]  Masanori Sugimoto,et al.  Toss-it: intuitive information transfer techniques for mobile devices , 2005, CHI EA '05.

[6]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[7]  Nadia Bianchi-Berthouze,et al.  Does Body Movement Engage You More in Digital Game Play? and Why? , 2007, ACII.

[8]  HyungSeok Kim,et al.  Gesture-Based Interactions on Multiple Large Displays with a Tabletop Interface , 2007, HCI.

[9]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[10]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[11]  Anastasia Bezerianos,et al.  The vacuum: facilitating the manipulation of distant objects , 2005, CHI.

[12]  Andreas Butz,et al.  Touch projector: mobile interaction through video , 2010, CHI.

[13]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[14]  Yang Li,et al.  User-defined motion gestures for mobile interaction , 2011, CHI.

[15]  Mary Czerwinski,et al.  Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-Operated Systems , 2003, INTERACT.