Touchy : A Visual Approach for Simulating Haptic Effects on Touchscreens

Haptic enhancement of touchscreens usually involves vibrating motors producing limited sensations or custom mechanical actuators that are difficult to disseminate. In this paper, we propose an alternative approach called "Touchy", where a symbolic cursor is introduced under the user's finger, to evoke various haptic properties through changes in its shape and motion. This novel metaphor enables to address four different perceptual dimensions, namely: hardness, friction, fine roughness and macro roughness. Our metaphor comes with a set of seven visual effects that we compared with real texture samples within a user study conducted with 14 participants. Taken together our results show that Touchy is able to elicit clear and distinct haptic properties: stiffness, roughness, reliefs, stickiness and slipperiness.

[1]  Patrick Baudisch,et al.  Snap-and-go: helping users align objects without the modality of traditional snapping , 2005, CHI.

[2]  Regan L. Mandryk,et al.  Sticky widgets: pseudo-haptic widget enhancements for multi-monitor displays , 2005, CHI Extended Abstracts.

[3]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[4]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[5]  Daniel M. Johnson,et al.  Enhancing physicality in touch interaction with programmable friction , 2011, CHI.

[6]  Anatole Lécuyer,et al.  Virtual technical trainer: learning how to use milling machines with multi-sensory feedback in virtual reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[7]  Ramesh Raskar,et al.  Simultaneous geometry and texture display based on lateral force for touchscreen , 2013, 2013 World Haptics Conference (WHC).

[8]  Mike Sinclair,et al.  TouchMover 2.0 - 3D touchscreen with force feedback and haptic texture , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[9]  Yvonne Jansen.  Mudpad: fluid haptics for multitouch surfaces , 2010, CHI EA '10.

[10]  Takuji Narumi,et al.  Yubi-Toko: finger walking in snowy scene using pseudo-haptic technique on touchpad , 2015, SIGGRAPH Asia Emerging Technologies.

[11]  Kosuke Sato,et al.  SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality , 2015, IEEE Transactions on Visualization and Computer Graphics.

[12]  Yeongmi Kim,et al.  SurfTics — Kinesthetic and tactile feedback on a touchscreen device , 2017, 2017 IEEE World Haptics Conference (WHC).

[13]  Miltiadis K. Hatalis,et al.  Tactile Displays : a short overview and recent developments , 2005 .

[14]  Kaspar Althoefer,et al.  Pseudo-haptics for rigid tool/soft surface interaction feedback in virtual environments , 2014 .

[15]  Heather Culbertson,et al.  The Penn Haptic Texture Toolkit for Modeling, Rendering, and Evaluating Haptic Virtual Textures , 2014 .

[16]  J. Edward Colgate,et al.  ShiverPaD: A Glass Haptic Surface That Produces Shear Force on a Bare Finger , 2010, IEEE Transactions on Haptics.

[17]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[18]  A. Kappers,et al.  Analysis of haptic perception of materials by multidimensional scaling and physical measurements of roughness and compressibility. , 2006, Acta psychologica.

[19]  Masahiko Inami,et al.  SmartTouch: electric skin to touch the untouchable , 2004, IEEE Computer Graphics and Applications.

[20]  Anatole Lécuyer,et al.  SAILOR: a 3-D medical simulator of loco-regional anaesthesia based on desktop virtual reality and pseudo-haptic feedback , 2008, VRST '08.

[21]  Wei Liu,et al.  Experimental Study on the Perception Characteristics of Haptic Texture by Multidimensional Scaling , 2015, IEEE Transactions on Haptics.

[22]  Seung-Chan Kim,et al.  Haptic interaction with virtual geometry on robotic touch surface , 2014, SIGGRAPH ASIA Emerging Technologies.

[23]  Yasuharu Koike,et al.  TCieX : An Environment for Designing and Experiencing A Variety of Visuo-Haptic Sensory Conflicts , 2012 .

[24]  Maud Marchal,et al.  Elastic images: Perceiving local elasticity of images through a novel pseudo-haptic deformation effect , 2013, TAP.

[25]  Daniel M. Johnson,et al.  ActivePaD surface haptic device , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[26]  Yon Visell,et al.  On Frictional Forces between the Finger and a Textured Surface during Active Touch , 2016, IEEE Transactions on Haptics.

[27]  Seung-Chan Kim,et al.  Tactile rendering of 3D features on touch surfaces , 2013, UIST.

[28]  Anatole Lécuyer,et al.  A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes , 2008, TAP.

[29]  Fabien Danieau,et al.  Texture Rendering on a Tactile Surface Using Extended Elastic Images and Example-Based Audio Cues , 2016, EuroHaptics.

[30]  Heather Culbertson,et al.  Should haptic texture vibrations respond to user force and speed? , 2015, 2015 IEEE World Haptics Conference (WHC).

[31]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[32]  Takuji Narumi,et al.  Representing normal and shearing forces on the mobile device with visuo-haptic interaction and a rear touch interface , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[33]  Eckehard G. Steinbach,et al.  A haptic texture database for tool-mediated texture recognition and classification , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[34]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.