Glissade: Generating Balance Shifting Feedback to Facilitate Auxiliary Digital Pen Input

This paper introduces Glissade, a digital pen that generates balance shifting feedback by changing the weight distribution of the pen. A pulley system shifts a brass mass inside the pen to change the pen's center of mass and moment of inertia. When the mass is stationary, the pen delivers a constant yet natural sensation of weight, which can be used to convey a status. The pen can also generate a variety of haptic clues by actuating the mass according to the tilt or rotation of the pen, two commonly-used auxiliary pen input channels. Glissade demonstrates new possibilities that balance shifting feedback can bring to digital pen interactions. We validated the usability of this feedback by determining the recognizability of six balance patterns – a mix of static and dynamic patterns chosen based on our design considerations – in two controlled experiments. The results show that, on average, the participants could distinguish between the patterns with a 94.25% accuracy. At the end, we demonstrate a set of novel interactions enabled by Glissade and discuss the directions for future research.

[1]  C. Swindells,et al.  TorqueBAR: an ungrounded haptic feedback device , 2003, ICMI '03.

[2]  Heather Culbertson,et al.  Generating haptic texture models from unconstrained tool-surface interactions , 2013, 2013 World Haptics Conference (WHC).

[3]  Masahiko Inami,et al.  ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing , 2010, CIE.

[4]  Hongan Wang,et al.  The tilt cursor: enhancing stimulus-response compatibility by providing 3d orientation cue of pen , 2007, CHI.

[5]  Xiaoying Sun,et al.  Enhancing Pen-based Interaction using Electrovibration and Vibration Haptic Feedback , 2017, CHI.

[6]  Sean White,et al.  uTrack: 3D input using two magnetic sensors , 2013, UIST.

[7]  Robert LiKamWa,et al.  SWISH: Shifting Weight-based Interfaces for Simulated Hydrodynamics in Mixed-Reality Fluid Vessels , 2019, Tangible and Embedded Interaction.

[8]  Sriram Subramanian,et al.  Multi-layer interaction for digital tables , 2006, UIST.

[9]  Motoki Miura,et al.  RodDirect: two-dimensional input with stylus knob , 2006, Mobile HCI.

[10]  Fabian Hemmert,et al.  Weight-shifting mobiles: automatic balancing in mobile phones , 2010, CHI EA '10.

[11]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[12]  Xiaojun Bi,et al.  Acquiring and pointing: an empirical study of pen-tilt-based interaction , 2011, CHI.

[13]  Jiro Tanaka,et al.  Stylus Enhancement to Enrich Interaction with Computers , 2007, HCI.

[14]  Takuji Narumi,et al.  Transcalibur: dynamic 2D haptic shape illusion of virtual object by weight moving VR controller , 2018, SIGGRAPH Posters.

[15]  Yang Li,et al.  The Adaptive Hybrid Cursor: A Pressure-Based Target Selection Technique for Pen-Based User Interfaces , 2007, INTERACT.

[16]  Kang Shi,et al.  PressureFish: a method to improve control of discrete pressure-based input , 2008, CHI.

[17]  Michael Rohs,et al.  Explorations in sound for tilting-based interfaces , 2006, ICMI '06.

[18]  Katherine J. Kuchenbecker Haptography: capturing the feel of real objects to enable authentic haptic rendering (invited paper) , 2008, HAS '08.

[19]  Darren Leigh,et al.  Haptic pen: a tactile feedback stylus for touch screens , 2004, UIST '04.

[20]  Allison M. Okamura,et al.  Sensory Substitution and Augmentation Using 3-Degree-of-Freedom Skin Deformation Feedback , 2015, IEEE Transactions on Haptics.

[21]  Ki-Uk Kyung,et al.  A new stylus for touchscreen devices , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[22]  Xiang 'Anthony' Chen,et al.  Motion and context sensing techniques for pen computing , 2013, Graphics Interface.

[23]  Errol R Hoffmann,et al.  Effects of pen design on drawing and writing performance. , 2009, Applied ergonomics.

[24]  Cagatay Basdogan,et al.  Haptic stylus with inertial and vibro-tactile feedback , 2013, 2013 World Haptics Conference (WHC).

[25]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[26]  Fong-Gong Wu,et al.  Performance study on touch-pens size in three screen tasks. , 2006, Applied ergonomics.

[27]  Yang Li,et al.  Experimental analysis of mode switching techniques in pen-based user interfaces , 2005, CHI.

[28]  Xiaoying Sun,et al.  EV-Pen: Leveraging Electrovibration Haptic Feedback in Pen Interaction , 2016, ISS.

[29]  Xiaojun Bi,et al.  An exploration of pen rolling for pen-based interaction , 2008, UIST '08.

[30]  Nicolai Marquardt,et al.  RealPen: Providing Realism in Handwriting Tasks on Touch Surfaces using Auditory-Tactile Feedback , 2016, UIST.

[31]  Fabian Hemmert,et al.  Weight-shifting mobiles: two-dimensional gravitational displays in mobile phones , 2010, CHI Extended Abstracts.

[32]  Sho Kamuro,et al.  Pen de touch , 2009, SIGGRAPH '09.

[33]  Geehyuk Lee,et al.  The IrPen: A 6-DOF Pen for Interaction with Tablet Computers , 2014, IEEE Computer Graphics and Applications.

[34]  Mandayam A. Srinivasan,et al.  Precise manipulation of GUI on a touch screen with haptic cues , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[35]  Yuta Sugiura,et al.  Gravitamine spice: a system that changes the perception of eating through virtual weight sensation , 2015, AH.

[36]  Patrick Baudisch,et al.  Hover widgets: using the tracking state to extend the capabilities of pen-operated devices , 2006, CHI.

[37]  Jun-Young Lee,et al.  wUbi-Pen: windows graphical user interface interacting with haptic feedback stylus , 2008, SIGGRAPH '08.

[38]  Chunyuan Liao,et al.  Pen-top feedback for paper-based interfaces , 2006, UIST.

[39]  Jun-Young Lee,et al.  Ubi-Pen: A Haptic Interface with Texture and Vibrotactile Display , 2009, IEEE Computer Graphics and Applications.

[40]  Hongan Wang,et al.  Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces , 2008, CHI.

[41]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[42]  Allison M. Okamura,et al.  Augmentation Of Stiffness Perception With a 1-Degree-of-Freedom Skin Stretch Device , 2014, IEEE Transactions on Human-Machine Systems.

[43]  Joseph M. Romano,et al.  The AirWand: Design and characterization of a large-workspace haptic device , 2009, 2009 IEEE International Conference on Robotics and Automation.

[44]  Ravin Balakrishnan,et al.  Pressure marks , 2007, CHI.

[45]  Junseok Park,et al.  Haptic Stylus and Empirical Studies on Braille, Button, and Texture Display , 2008, Journal of biomedicine & biotechnology.

[46]  Andrea Bunt,et al.  A-coord input: coordinating auxiliary input streams for augmenting contextual pen-based interactions , 2012, CHI.