Psychophysical Model for Vibrotactile Rendering in Mobile Devices

Vibrotactile rendering is one of the most popular means for improving the user interface of a mobile device, but the availability of related perceptual data that can aid vibrotactile effect design is not currently sufficient. The present paper reports data from a series of psychophysical studies designed to fill this gap. In Experiment I, we measured the absolute detection thresholds of sinusoidal vibrotactile stimuli transmitted to the hand through a mobile phone. Stimuli were generated by a mechanical shaker system that can produce vibrations over a broad frequency and amplitude range. The detection thresholds reported here are a new addition to the literature, and can serve as a baseline for vibrotactile stimulus design. In Experiment II, we estimated the perceived intensities of mobile device vibrations for various frequencies and amplitudes using the same shaker system. We also determined a form of parametric nonlinear function based on Stevens' power law and fit the function to the measured data. This psychophysical magnitude function, which maps vibration frequency and amplitude to a resulting perceived intensity, can be used to predict the perceived intensity of a mobile device vibration from its physical parameter values. In Experiment III, we measured another set of perceived intensities using two commercial miniature vibration actuators (vibration motor and voice-coil actuator) in place of the mechanical shaker. The purpose of this experiment was to evaluate the utility of the psychophysical magnitude function obtained in Experiment II, as vibrotactile stimuli produced by miniature actuators may have different physical characteristics, such as vibration direction and ground condition. Comparison of the results of Experiments II and III confirmed that the psychophysical magnitude function can reliably predict changing trends in the perceived intensity of mobile device vibration. We also discuss further research issues encountered during the investigation. The results presented in this paper may be instrumental in the design of effective vibrotactile actuators and perceptually-salient rendering algorithms for mobile devices.

[1]  Ali Israr,et al.  Detection Threshold and Mechanical Impedance of the Hand in a Pen-Hold Posture , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  S. S. Stevens.  Tactile vibration: dynamics of sensory intensity. , 1959, Journal of experimental psychology.

[3]  Michael J. Griffin,et al.  Frequency dependence of perceived intensity of steering wheel vibration: effect of grip force , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[4]  Barbara Leporini,et al.  Vibrotactile feedback as an orientation aid for blind users of mobile guides , 2008, Mobile HCI.

[5]  Roderick Murray-Smith,et al.  Shoogle: excitatory multimodal interaction on mobile devices , 2007, CHI.

[6]  S S Hsiao,et al.  Detection of vibration transmitted through an object grasped in the hand. , 1999, Journal of neurophysiology.

[7]  Lorna M. Brown,et al.  Feel who's talking: using tactons for mobile phone alerts , 2006, CHI Extended Abstracts.

[8]  Stephen A. Brewster,et al.  T-Bars: towards tactile user interfaces for mobile touchscreens , 2008, Mobile HCI.

[9]  M. Griffin,et al.  Thresholds for the perception of hand-transmitted vibration: Dependence on contact area and contact location , 2005, Somatosensory & motor research.

[10]  Seungmoon Choi,et al.  Improving vibrotactile pattern identification for mobile devices using perceptually transparent rendering , 2010, Mobile HCI.

[11]  J. Zwislocki,et al.  Absolute scaling of sensory magnitudes: A validation , 1980, Perception & psychophysics.

[12]  Hsin-Yun Yao,et al.  Perceived Vibration Strength in Mobile Devices: The Effect of Weight and Frequency , 2010, IEEE Transactions on Haptics.

[13]  George A. Gescheider,et al.  Psychophysics: The Fundamentals , 1997 .

[14]  Alireza Sahami Shirazi,et al.  Rich Tactile Output on Mobile Devices , 2008, AmI.

[15]  Sebastian Merchel,et al.  Electrotactile Feedback for Handheld Devices with Touch Screen and Simulation of Roughness , 2012, IEEE Transactions on Haptics.

[16]  S. Lederman,et al.  Human Hand Function , 2006 .

[17]  R. T. Verrillo.  TEMPORAL SUMMATION IN VIBROTACTILE SENSITIVITY. , 1965, The Journal of the Acoustical Society of America.

[18]  Stephen A. Brewster,et al.  Mobile Multi-actuator Tactile Displays , 2007, HAID.

[19]  Jaehoon Jung,et al.  Perceived Magnitudes of Vibrations Transmitted Through Mobile Device , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[20]  Ivan Poupyrev,et al.  Tactile interfaces for small touch screens , 2003, UIST '03.

[21]  D. D. Reynolds,et al.  Hand-arm vibration, Part III: Subjective response characteristics of individuals to hand-induced vibration , 1977 .

[22]  G. Gescheider.  Psychophysics: The Fundamentals , 1997 .

[23]  Hong Z. Tan,et al.  The Body Surface as a Communication System: The State of the Art after 50 Years , 2007, PRESENCE: Teleoperators and Virtual Environments.

[24]  A. Fraioli,et al.  Sensation magnitude of vibrotactile stimuli , 1969 .

[25]  Ali Israr,et al.  Mechanical Impedance of the Hand Holding a Spherical Tool at Threshold and Suprathreshold Stimulation Levels , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[26]  William G. Griswold,et al.  Peopletones: a system for the detection and notification of buddy proximity on mobile phones , 2008, MobiSys '08.

[27]  H. Levitt.  Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[28]  R. T. Verrillo,et al.  Effect of stimulus duration on vibrotactile sensation magnitude , 1976 .

[29]  Dong-Soo Kwon,et al.  Interaction with a display panel - An evaluation of surface-transmitted haptic feedback , 2008, 2008 International Conference on Control, Automation and Systems.

[30]  Angela Chang,et al.  Audio-haptic feedback in mobile phones , 2005, CHI Extended Abstracts.

[31]  Jaehoon Jung,et al.  Perceived Magnitude and Power Consumption of Vibration Feedback in Mobile Devices , 2007, HCI.

[32]  Seungmoon Choi,et al.  Benefits of Perceptually Transparent Vibration Rendering in Mobile Device , 2008, EuroHaptics.

[33]  R T Verrillo,et al.  Effects of aging on the suprathreshold responses to vibration , 1982, Perception & psychophysics.

[34]  S. S. Stevens.  On the psychophysical law. , 1957, Psychological review.

[35]  Stephen A. Brewster,et al.  Crossmodal icons for information display , 2006, CHI EA '06.

[36]  Jun Rekimoto,et al.  PreSenseII: bi-directional touch and pressure sensing interactions with tactile feedback , 2006, CHI Extended Abstracts.

[37]  Lorna M. Brown,et al.  Shake2Talk: Multimodal Messaging for Interpersonal Communication , 2007, HAID.

[38]  R. T. Verrillo,et al.  Effect of stimulus frequency on subjective vibrotactile magnitude functions , 1975 .

[39]  Sharif Razzaque,et al.  Tactile virtual buttons for mobile devices , 2003, CHI Extended Abstracts.

[40]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[41]  Roope Raisamo,et al.  Telling Time by Vibration , 2008, EuroHaptics.

[42]  Toshiaki Sugimura,et al.  Active click: tactile feedback for touch panels , 2001, CHI Extended Abstracts.

[43]  Pradeep K. Khosla,et al.  Psychophysical Characterization and Testbed Validation of a Wearable Vibrotactile Glove for Telemanipulation , 2003, Presence: Teleoperators & Virtual Environments.

[44]  Karon E. MacLean,et al.  Foundations of Transparency in Tactile Information Design , 2008, IEEE Transactions on Haptics.

[45]  Michael J. Griffin,et al.  Magnitude-dependence of equivalent comfort contours for fore-and-aft, lateral and vertical whole-body vibration , 2006 .

[46]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[47]  M. Leek.  Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.