Effect of Electrostatic Tactile Feedback on Accuracy and Efficiency of Pan Gestures on Touch Screens

Recently, many studies examined electrostatic tactile feedback on touch screens to enrich interaction experience. However, it is unclear as to whether added tactile feedback during a sliding process increases the accuracy of pan gestures with velocity constraints. In this study, a custom-designed electrostatic tactile display was considered. Initially, the accuracy and efficiency of pan gestures were compared under two conditions, namely with and without electrostatic tactile feedback. This was followed by exploring the evolution of completion time (CT) with different indices of difficulties (ID). Experimental results with 12 participants indicated that the accuracy and completion time of pan gestures with added tactile feedback significantly exceeded those without tactile feedback. Furthermore, the relationship between CT and ID satisfied Fitts' Law with a correlation coefficient exceeding 0.9. Based on the findings, a “Tactile Fruit Sorting” game was designed, and subjective and objective evaluations were conducted. The results confirmed that the added tactile feedback enhanced both user performance and interest with respect to the game.

[1]  J. Edward Colgate,et al.  Fingertip friction modulation due to electrostatic attraction , 2013, 2013 World Haptics Conference (WHC).

[2]  Y. Ikei,et al.  Texture presentation by vibratory tactile display-image based presentation of a tactile texture , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[3]  John C. Thomas,et al.  Exploring pinch and spread gestures on mobile devices , 2013, MobileHCI '13.

[4]  J. Edward Colgate,et al.  Friction measurements on a Large Area TPaD , 2010, 2010 IEEE Haptics Symposium.

[5]  Xiang Cao,et al.  SlickFeel: sliding and clicking haptic feedback on a touchscreen , 2012, UIST Adjunct Proceedings '12.

[6]  Nicolas Roussel,et al.  STIMTAC: a tactile input device with programmable friction , 2011, UIST '11 Adjunct.

[7]  Nicolas Roussel,et al.  Surfpad: riding towards targets on a squeeze film effect , 2011, CHI.

[8]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[9]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[10]  Olivier Bau,et al.  REVEL: tactile feedback technology for augmented reality , 2012, ACM Trans. Graph..

[11]  Christopher R. Wagner,et al.  A tactile shape display using RC servomotors , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[12]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[13]  Vincent Hayward,et al.  Tactile Display Device Using Distributed Lateral Skin Stretch , 2000, Dynamic Systems and Control: Volume 2.

[14]  Betty Lemaire-Semail,et al.  Physical and Perceptual Independence of Ultrasonic Vibration and Electrovibration for Friction Modulation , 2015, IEEE Transactions on Haptics.

[15]  Karon E. MacLean,et al.  Exploring the design space of programmable friction for scrolling interactions , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[16]  F. Brooks,et al.  Feeling and seeing: issues in force display , 1990, ACM Symposium on Interactive 3D Graphics and Games.

[17]  Xiaoying Sun,et al.  Electrostatic tactile rendering of image based on shape from shading , 2014, 2014 International Conference on Audio, Language and Image Processing.

[18]  Koichiro Deguchi,et al.  Lateral-force-based 2.5-dimensional tactile display for touch screen , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[19]  강성철,et al.  T-Mobile: Vibrotactile Display Pad with Spatial and Directional Information for Hand-held Device , 2010 .

[20]  Daniel Vogel,et al.  Pinch-to-zoom-plus: an enhanced pinch-to-zoom that reduces clutching and panning , 2014, UIST.

[21]  Xiaoying Sun,et al.  Tactile modeling and rendering image-textures based on electrovibration , 2017, The Visual Computer.

[22]  Jeha Ryu,et al.  Method for Providing Electrovibration with Uniform Intensity , 2015, IEEE Transactions on Haptics.

[23]  Akio Yamamoto,et al.  Electrostatic Tactile Display with Thin Film Slider and Its Application to Tactile Telepresentation Systems , 2006, IEEE Trans. Vis. Comput. Graph..

[24]  Wanjoo Park,et al.  Neural Activations Associated With Friction Stimulation on Touch-Screen Devices , 2019, Front. Neurorobot..

[25]  J. Edward Colgate,et al.  Dynamics of ultrasonic and electrostatic friction modulation for rendering texture on haptic surfaces , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[26]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[27]  Yang Zhang,et al.  Quantifying the Targeting Performance Benefit of Electrostatic Haptic Feedback on Touchscreens , 2015, ITS.

[28]  Daniel M. Johnson,et al.  Enhancing physicality in touch interaction with programmable friction , 2011, CHI.