Gesture output: eyes-free output using a force feedback touch surface

We propose using spatial gestures not only for input but also for output. Analogous to gesture input, the proposed gesture output moves the user's finger in a gesture, which the user then recognizes. We use our concept in a mobile scenario where a motion path forming a "5" informs users about new emails, or a heart-shaped path serves as a mes- sage from a friend. We built two prototypes: (1) The long- RangeOuija is a stationary prototype that offers a motion range of up to 4cm; (2) The pocketOuija is self-contained mobile device based on an iPhone with up to 1cm motion range. Both devices actuate the user's fingers by means of an actuated transparent foil overlaid onto a touchscreen. We conducted three studies with the longRangeOuija in which participants recognized 2cm marks with 97% accu- racy, Graffiti digits with 98.8%, pairs of Graffiti digits with 90.5%, and Graffiti letters with 93.4%. Participants previ- ously unfamiliar with Graffiti identified 96.2% of digits and 76.4% of letters, suggesting that properly designed gesture output is guessable. After the experiment, the same participants were able to enter 100% of Graffiti digits by heart and 92.2% of letters. This suggests that participants learned gesture input as a side effect of using gesture output on our prototypes.

[1]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[2]  Yi Yang,et al.  FingViewer: A new multi-touch force feedback touch screen , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[3]  F A GELDARD,et al.  Some neglected possibilities of communication. , 1960, Science.

[4]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[5]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[6]  D. Maynes-Aminzade,et al.  The actuated workbench: computer-controlled actuation in tabletop tangible interfaces , 2003, ACM Trans. Graph..

[7]  I. Scott MacKenzie,et al.  The Immediate Usability of Graffiti , 1997, Graphics Interface.

[8]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[9]  Patrick Baudisch,et al.  Disappearing mobile devices , 2009, UIST '09.

[10]  Scott Brave,et al.  inTouch: a medium for haptic interpersonal communication , 1997, CHI Extended Abstracts.

[11]  C M Reed,et al.  Reception of Morse code through motional, vibrotactile, and auditory stimulation , 1997, Perception & psychophysics.

[12]  Karon E. MacLean,et al.  The hapticon editor: a tool in support of haptic communication research , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[13]  Seungmoon Choi,et al.  Initial study for creating linearly moving vibrotactile sensation on mobile device , 2010, 2010 IEEE Haptics Symposium.

[14]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[15]  Roderick Murray-Smith,et al.  Shoogle: excitatory multimodal interaction on mobile devices , 2007, CHI.

[16]  Thenkurussi Kesavadas,et al.  Motor skill training assistance using haptic attributes , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[17]  James D. Hollan,et al.  Designing easily learnable eyes-free interaction , 2008 .

[18]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[19]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[20]  Chris Harrison,et al.  PocketTouch: through-fabric capacitive touch input , 2011, UIST '11.

[21]  Daniel M. Johnson,et al.  ActivePaD surface haptic device , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[22]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[23]  J. Edward Colgate,et al.  ShiverPaD: A Glass Haptic Surface That Produces Shear Force on a Bare Finger , 2010, IEEE Transactions on Haptics.

[24]  James D. Hollan,et al.  Tapping and rubbing: exploring new dimensions of tactile feedback with voice coil motors , 2008, UIST '08.

[25]  William Buxton,et al.  Issues in combining marking and direct manipulation techniques , 1991, UIST '91.

[26]  Tsuneo Yoshikawa,et al.  Toward machine mediated training of motor skills. Skill transfer from human to human via virtual environment , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[27]  Jan O. Borchers,et al.  FingerFlux: near-surface haptic feedback on tabletops , 2011, UIST.

[28]  Yang Li,et al.  Experimental analysis of touch-screen gesture designs in mobile environments , 2011, CHI.

[29]  Tsutomu Miyasato,et al.  A palmtop display for dextrous manipulation with haptic sensation , 1996, CHI.

[30]  Hiroshi Ishii,et al.  Mechanical constraints as computational constraints in tabletop tangible interfaces , 2007, CHI.

[31]  Etienne Burdet,et al.  A robotic teacher of Chinese handwriting , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[32]  Makoto Sato,et al.  Development of String-based Force Display: SPIDAR , 2002 .

[33]  David W. L. Wang,et al.  Haptic overlay device for flat panel touch displays , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[34]  M A Srinivasan,et al.  Development and evaluation of an epidural injection simulator with force feedback for medical training. , 2001, Studies in health technology and informatics.

[35]  Jan O. Borchers,et al.  Madgets: actuating widgets on interactive tabletops , 2010, UIST.