wUbi-Pen: Sensory Feedback Stylus Interacting with Graphical User Interface

In this work, we designed an interactive stylus interface for touch-screen devices, the wUbi-Pen haptic stylus. The stylus has functions of providing both vibration and impact with a single actuator, and it is a stand-alone system including its own battery and communication module. We present a new interaction scheme on the graphical user interface (GUI) based on sensory feedback events for clicking, drag-and-drop, moving, sliding, highlighting, and drawing. Experiments evaluating stylus performance indicated that the haptic cues improved precise control of GUI elements. A simple interactive digital sketchbook was also implemented, which provided a variety of haptic feedback while drawing and touching objects.

[1]  John R. Wilson,et al.  Structured Evaluation of Virtual Environments for Special-Needs Education , 1999, Presence: Teleoperators & Virtual Environments.

[2]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[3]  Jun-Young Lee,et al.  Ubi-Pen: A Haptic Interface with Texture and Vibrotactile Display , 2009, IEEE Computer Graphics and Applications.

[4]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[5]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[6]  Blake Hannaford,et al.  Pen-based force display for precision manipulation in virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[7]  Shumin Zhai,et al.  The performance of touch screen soft buttons , 2009, CHI.

[8]  Mandayam A. Srinivasan,et al.  Haptic texture generation using stochastic models and teleoperation , 2012 .

[9]  Jun Rekimoto,et al.  TouchEngine: a tactile display for handheld devices , 2002, CHI Extended Abstracts.

[10]  Ivan Poupyrev,et al.  Tactile interfaces for small touch screens , 2003, UIST '03.

[11]  Vincent Hayward,et al.  A role for haptics in mobile interaction: initial design using a handheld tactile display prototype , 2006, CHI.

[12]  Charles Lenay,et al.  Perceptive Supplementation for an Access to Graphical Interfaces , 2007, HCI.

[13]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[14]  Mandayam A. Srinivasan,et al.  Precise manipulation of GUI on a touch screen with haptic cues , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[15]  Heather Culbertson,et al.  Generating haptic texture models from unconstrained tool-surface interactions , 2013, 2013 World Haptics Conference (WHC).

[16]  Darren Leigh,et al.  Haptic pen: a tactile feedback stylus for touch screens , 2004, UIST '04.