Tri-Modal Tactile Display and Its Application Into Tactile Perception of Visualized Surfaces

Tactile representation on touchscreens plays an important role in improving realism and richness of users’ interaction experience. The dynamic lateral force range and the efficient feedback dimensions are very critical in determining the fidelity of tactile displays. This article develops a tri-modal Electrovibration, Ultrasonic Vibration, and Mechanical Vibration (EUMV) tactile display integrating three types of representative principles, which enhances the dynamic lateral force range by leveraging electrostatic and ultrasonic vibrations stimuli, and induces the normal feedback dimension by utilizing mechanical vibration stimulus. Then, a tactile perception scheme with the EUMV display is proposed for simultaneously rendering contour and texture roughness features of visualized surfaces, in which the contour gradient-lateral force model and the texture gradient-perceived roughness model are determined respectively. Objective and subjective evaluations with 20 participants show that the novel scheme establishes significant improvements in both correct recognition ratios of geometric shapes and tactile perception realism of visualized images than the previous studies.

[1]  J. Edward Colgate,et al.  UltraShiver: Lateral force feedback on a bare fingertip via ultrasonic oscillation and electroadhesion , 2018, 2018 IEEE Haptics Symposium (HAPTICS).

[2]  Xiaoying Sun,et al.  Effect of Electrostatic Tactile Feedback on Accuracy and Efficiency of Pan Gestures on Touch Screens , 2018, IEEE Transactions on Haptics.

[3]  Sang-Youn Kim,et al.  Vibrotactile Rendering for a Traveling Vibrotactile Wave Based on a Haptic Processor , 2012, IEEE Transactions on Haptics.

[4]  Cagatay Basdogan,et al.  Psychophysical Evaluation of Change in Friction on an Ultrasonically-Actuated Touchscreen , 2018, IEEE Transactions on Haptics.

[5]  Betty Lemaire-Semail,et al.  Merging two tactile stimulation principles: electrovibration and squeeze film effect , 2013, 2013 World Haptics Conference (WHC).

[6]  Seungmoon Choi,et al.  Improving 3D Shape Recognition withElectrostatic Friction Display , 2017, IEEE Transactions on Haptics.

[7]  Toshio Watanabe,et al.  A method for controlling tactile sensation of surface roughness using ultrasonic vibration , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[8]  Seung-Chan Kim,et al.  Tactile rendering of 3D features on touch surfaces , 2013, UIST.

[9]  Donald E. Troxel,et al.  An Electrotactile Display , 1970 .

[10]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[11]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[12]  Christophe Giraud-Audine,et al.  Enhancing Variable Friction Tactile Display Using an Ultrasonic Travelling Wave , 2017, IEEE Transactions on Haptics.

[13]  Xiaoying Sun,et al.  Tactile modeling and rendering image-textures based on electrovibration , 2017, The Visual Computer.

[14]  Hong Z. Tan,et al.  Discrimination of Real and Virtual Surfaces with Sinusoidal and Triangular Gratings Using the Fingertip and Stylus , 2013, IEEE Transactions on Haptics.

[15]  B. Lemaire-Semail,et al.  Squeeze film effect for the design of an ultrasonic tactile plate , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[16]  J. Edward Colgate,et al.  The application of tactile, audible, and ultrasonic forces to human fingertips using broadband electroadhesion , 2017, 2017 IEEE World Haptics Conference (WHC).

[17]  Ken Ito,et al.  High-Quality Texture Display: The Use of Vibrotactile and Variable-Friction Stimuli in Conjunction , 2016, AsiaHaptics.

[18]  Betty Lemaire-Semail,et al.  Friction Reduction through Ultrasonic Vibration Part 2: Experimental Evaluation of Intermittent Contact and Squeeze Film Levitation , 2017, IEEE Transactions on Haptics.

[19]  Anne Marie Piper,et al.  TPad Fire : Surface Haptic Tablet , 2013 .

[20]  E MALLINCKRODT,et al.  Perception by the skin of electrically induced vibrations. , 1953, Science.

[21]  Frédéric Giraud,et al.  Friction Reduction through Ultrasonic Vibration Part 1: Modelling Intermittent Contact , 2017, IEEE Transactions on Haptics.

[22]  D. Kwon,et al.  Mechanical Vibration Influences the Perception of Electrovibration , 2018, Scientific Reports.

[23]  Gi-Hun Yang,et al.  T-mobile: Vibrotactile display pad with spatial and directional information for hand-held device , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  J. Edward Colgate,et al.  Dynamics of ultrasonic and electrostatic friction modulation for rendering texture on haptic surfaces , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[25]  Koichi Hirota,et al.  Modulating Fine Roughness Perception of Vibrotactile Textured Surface using Pseudo-haptic Effect , 2019, IEEE Transactions on Visualization and Computer Graphics.

[26]  Betty Lemaire-Semail,et al.  Physical and Perceptual Independence of Ultrasonic Vibration and Electrovibration for Friction Modulation , 2015, IEEE Transactions on Haptics.

[27]  Jenna L. Gorlewicz,et al.  HUE: A hybrid ultrasonic and electrostatic variable friction touchscreen , 2017, 2017 IEEE World Haptics Conference (WHC).

[28]  Vincent Hayward,et al.  Perception of simulated local shapes using active and passive touch. , 2009, Journal of neurophysiology.

[29]  Jeha Ryu,et al.  Method for Providing Electrovibration with Uniform Intensity , 2015, IEEE Transactions on Haptics.

[30]  J. Edward Colgate,et al.  T-PaD: Tactile Pattern Display through Variable Friction Reduction , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[31]  Ken Ito,et al.  A texture display using vibrotactile and electrostatic friction stimuli surpasses one based on either type of stimulus , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[32]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[33]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[34]  Shuhei Asano,et al.  Vibrotactile Stimulation to Increase and Decrease Texture Roughness , 2015, IEEE Transactions on Human-Machine Systems.

[35]  V. Hayward,et al.  Localized Tactile Feedback on a Transparent Surface through Time-Reversal Wave Focusing , 2015, IEEE Transactions on Haptics.