Tactile Perception of Virtual Edges and Gratings Displayed by Friction Modulation via Ultrasonic Actuation

Tactile discrimination and roughness perception of real textures are extensively studied and underlying perceptual mechanisms are relatively well-established. However, tactile perception of virtual textures rendered by friction modulation techniques on touch surfaces has not been investigated in detail yet. In this article, we investigated our ability to discriminate two consecutive step changes in friction (called edges), followed by discrimination and roughness perception of multiple edges (called periodic gratings). The results showed that discrimination of two consecutive edges was significantly influenced by edge sequence: a step fall in friction (<inline-formula><tex-math notation="LaTeX">$FF$</tex-math></inline-formula>) followed by a step rise in friction (<inline-formula><tex-math notation="LaTeX">$RF$</tex-math></inline-formula>) was discriminated more easily than the reverse order. On the other hand, periodic gratings displayed by consecutive sequences of <inline-formula><tex-math notation="LaTeX">$FF$</tex-math></inline-formula> followed by <inline-formula><tex-math notation="LaTeX">$RF$</tex-math></inline-formula> were perceived with the same acuity as compared to vice versa. Independent of the edge sequence, we found that a relative difference of 14% in spatial period was required to discriminate two periodic gratings. Moreover, the roughness perception of periodic gratings decreased with increasing spatial period for the range that we have investigated (spatial period <inline-formula><tex-math notation="LaTeX">$>$</tex-math></inline-formula> 2 mm), despite the lack of spatial cues on grating height. We also observed that rate of change in friction coefficient was better correlated with the roughness perception than the friction coefficient itself. These results will further help to understand and design virtual textures for touch surfaces.

[1]  Hong Z. Tan,et al.  Discrimination of Real and Virtual Surfaces with Sinusoidal and Triangular Gratings Using the Fingertip and Stylus , 2013, IEEE Transactions on Haptics.

[2]  C. E. Chapman,et al.  Role of friction and tangential force variation in the subjective scaling of tactile roughness , 2002, Experimental Brain Research.

[3]  Cagatay Basdogan,et al.  HapTable: An Interactive Tabletop Providing Online Haptic Feedback for Touch Gestures , 2019, IEEE Transactions on Visualization and Computer Graphics.

[4]  Roberta L. Klatzky,et al.  Roughness Perception in Virtual Textures , 2011, IEEE Transactions on Haptics.

[5]  A. Freeman,et al.  A model accounting for effects of vibratory amplitude on responses of cutaneous mechanoreceptors in macaque monkey , 1982, The Journal of physiology.

[6]  M. Hollins,et al.  Pacinian representations of fine surface texture , 2005, Perception & psychophysics.

[7]  Betty Lemaire-Semail,et al.  Design and control of a haptic knob , 2013 .

[8]  Vuokko Lantz,et al.  Design of Dynamic Vibrotactile Textures , 2010, IEEE Transactions on Haptics.

[9]  J. Koenderink,et al.  Amplitude and Spatial-Period Discrimination in Sinusoidal Gratings by Dynamic Touch , 2001, Perception.

[10]  Kenneth O. Johnson,et al.  Neural Coding Mechanisms Underlying Perceived Roughness of Finely Textured Surfaces , 2001, The Journal of Neuroscience.

[11]  J J Zwislocki,et al.  On a psychophysical transformed-rule up and down method converging on a 75% level of correct responses , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Mark Holliins,et al.  Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis , 1993, Perception & psychophysics.

[13]  Susan J. Lederman,et al.  The perceived roughness of resistive virtual textures: I. rendering by a force-feedback mouse , 2006, TAP.

[14]  Seungmoon Choi,et al.  An inverse neural network model for data-driven texture rendering on electrovibration display , 2018, 2018 IEEE Haptics Symposium (HAPTICS).

[15]  J. Edward Colgate,et al.  Modeling and synthesis of tactile texture with spatial spectrograms for display on variable friction surfaces , 2015, 2015 IEEE World Haptics Conference (WHC).

[16]  A. Goodwin,et al.  Perceived roughness of a grating: correlation with responses of mechanoreceptive afferents innervating the monkey's fingerpad , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Marc O. Ernst,et al.  Path integration in tactile perception of shapes , 2014, Behavioural Brain Research.

[18]  Yang Zhang,et al.  Quantifying the Targeting Performance Benefit of Electrostatic Haptic Feedback on Touchscreens , 2015, ITS.

[19]  Seungmoon Choi,et al.  Improving 3D Shape Recognition withElectrostatic Friction Display , 2017, IEEE Transactions on Haptics.

[20]  Seung-Chan Kim,et al.  Tactile rendering of 3D features on touch surfaces , 2013, UIST.

[21]  A. Goodwin,et al.  Tactile discrimination of gratings , 2004, Experimental Brain Research.

[22]  Frédéric Giraud,et al.  Discrimination of Virtual Square Gratings by Dynamic Touch on Friction Based Tactile Displays , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[23]  Forrest W. Young,et al.  Individual differences in perceptual space for tactile textures: Evidence from multidimensional scaling , 2000, Perception & psychophysics.

[24]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[25]  Knut Drewing,et al.  Low-Amplitude Textures Explored with the Bare Finger: Roughness Judgments Follow an Inverted U-Shaped Function of Texture Period Modified by Texture Type , 2016, EuroHaptics.

[26]  Laurent Grisoni,et al.  Determining the haptic feedback position for optimizing the targeting performance on ultrasonic tactile displays , 2018, 2018 IEEE Haptics Symposium (HAPTICS).

[27]  Cagatay Basdogan,et al.  Psychophysical Evaluation of Change in Friction on an Ultrasonically-Actuated Touchscreen , 2018, IEEE Transactions on Haptics.

[28]  Betty Lemaire-Semail,et al.  The Perception of Ultrasonic Square Reductions of Friction With Variable Sharpness and Duration , 2019, IEEE Transactions on Haptics.

[29]  Vincent Hayward,et al.  Roughness of simulated surfaces examined with a haptic tool: effects of spatial period, friction, and resistance amplitude , 2010, Experimental Brain Research.

[30]  Jocelyn Monnoyer,et al.  Harmonious Textures: The Perceptual Dimensions of Synthetic Sinusoidal Gratings , 2018, EuroHaptics.

[31]  J Edward Colgate,et al.  Partial squeeze film levitation modulates fingertip friction , 2016, Proceedings of the National Academy of Sciences.

[32]  Hannes P. Saal,et al.  Touch is a team effort: interplay of submodalities in cutaneous sensibility , 2014, Trends in Neurosciences.

[33]  J. Edward Colgate,et al.  Dynamics of ultrasonic and electrostatic friction modulation for rendering texture on haptic surfaces , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[34]  Gholamreza Ilkhani,et al.  Data-Driven Texture Rendering on an Electrostatic Tactile Display , 2017, Int. J. Hum. Comput. Interact..

[35]  S. Lederman Tactual roughness perception: Spatial and temporal determinants. , 1983 .

[36]  R. Klatzky,et al.  Haptic Roughness Perception of Linear Gratings via Bare Finger or Rigid Probe , 2007, Perception.

[37]  Ki-Suk Kim,et al.  Two-point discrimination values vary depending on test site, sex and test modality in the orofacial region: a preliminary study , 2017, Journal of applied oral science : revista FOB.

[38]  Laurent Grisoni,et al.  Finding the Minimum Perceivable Size of a Tactile Element on an Ultrasonic Based Haptic Tablet , 2016, ISS.

[39]  Keehoon Kim,et al.  An empirical study of rendering sinusoidal textures on a ultrasonic variable-friction haptic surface , 2015, 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[40]  J. Edward Colgate,et al.  Search Efficiency for Tactile Features Rendered by Surface Haptic Displays , 2014, IEEE Transactions on Haptics.

[41]  Xiaoying Sun,et al.  Data-driven rendering of fabric textures on electrostatic tactile displays , 2018, 2018 IEEE Haptics Symposium (HAPTICS).

[42]  M. M. Taylor,et al.  Tactile roughness of grooved surfaces: A model and the effect of friction , 1975 .

[43]  Cagatay Basdogan,et al.  Roughness perception of virtual textures displayed by electrovibration on touch screens , 2017, 2017 IEEE World Haptics Conference (WHC).

[44]  S. Lederman Tactile roughness of grooved surfaces: The touching process and effects of macro- and microsurface structure , 1974 .

[45]  J. Edward Colgate,et al.  Surface haptics via electroadhesion: Expanding electrovibration with Johnsen and Rahbek , 2015, 2015 IEEE World Haptics Conference (WHC).

[46]  R. Johansson,et al.  Encoding of Direction of Fingertip Forces by Human Tactile Afferents , 2001, The Journal of Neuroscience.

[47]  Daniel M. Johnson,et al.  Enhancing physicality in touch interaction with programmable friction , 2011, CHI.

[48]  Knut Drewing,et al.  Judged Roughness as a Function of Groove Frequency and Groove Width in 3D-Printed Gratings , 2018, EuroHaptics.

[49]  Mark Hollins,et al.  The coding of roughness. , 2007, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[50]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[51]  Laurent Grisoni,et al.  Localized Haptic Texture: A Rendering Technique based on Taxels for High Density Tactile Feedback , 2017, CHI.

[52]  Toshio Watanabe,et al.  A method for controlling tactile sensation of surface roughness using ultrasonic vibration , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[53]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[54]  K. Sathian,et al.  Temporal Cues Contribute to Tactile Perception of Roughness , 2001, The Journal of Neuroscience.

[55]  Susan J. Lederman,et al.  The perceived roughness of resistive virtual textures: II. effects of varying viscosity with a force-feedback device , 2006, TAP.

[56]  L KlatzkyRoberta,et al.  The perceived roughness of resistive virtual textures , 2006 .

[57]  Cagatay Basdogan,et al.  Effect of Waveform on Tactile Perception by Electrovibration Displayed on Touch Screens , 2017, IEEE Transactions on Haptics.

[58]  Betty Lemaire-Semail,et al.  Textile Fabrics' Texture: From Multi-level Feature Extraction to Tactile Simulation , 2016, EuroHaptics.

[59]  M. Biet,et al.  Implementation of tactile feedback by modifying the perceived friction , 2008 .

[60]  Betty Lemaire-Semail,et al.  Texture Rendering Strategies with a High Fidelity - Capacitive Visual-Haptic Friction Control Device , 2016, EuroHaptics.

[61]  J. Edward Colgate,et al.  Single pitch perception of multi-frequency textures , 2018, 2018 IEEE Haptics Symposium (HAPTICS).