Improving Perception Accuracy with Multi-sensory Haptic Cue Delivery

This paper presents a novel, wearable, and multi-sensory haptic feedback system intended to support the transmission of large sets of haptic cues that are accurately perceived by the human user. Previous devices have focused on the optimization of haptic cue transmission using a single modality and have typically employed arrays of haptic tactile actuators to maximize information throughput to a user. However, when large cue sets are to be transmitted, perceptual interference between transmitted cues can decrease the efficacy of single-sensory systems. Therefore, we present MISSIVE (Multi-sensory Interface of Stretch, Squeeze, and Integrated Vibration Elements), a wearable system that conveys multi-sensory haptic cues to the user’s upper arm, allowing for increased perceptual accuracy compared to a single-sensory vibrotactile array of a comparable size, conveying the same number of cues. Our multi-sensory haptic cues are comprised of concurrently rendered, yet perceptually distinct elements: radial squeeze, lateral skin stretch, and localized cutaneous vibration. Our experiments demonstrate that our approach can increase perceptual accuracy compared to a single-sensory vibrotactile system of comparable size and that users prefer MISSIVE.

[1]  Lorraine A. Delhorne,et al.  Current Results of a Field Study of Adult Users of Tactile Aids , 1995 .

[2]  Karon E. MacLean,et al.  Perceiving ordinal data haptically under workload , 2005, ICMI '05.

[3]  E. A. Alluisi,et al.  An information analysis of verbal and motor responses in a forced-paced serial task. , 1957, Journal of experimental psychology.

[4]  Ali Israr,et al.  Discrimination of consonant articulation location by tactile stimulation of the forearm , 2010, 2010 IEEE Haptics Symposium.

[5]  Simona Casini,et al.  Design and realization of the CUFF - clenching upper-limb force feedback wearable device for distributed mechano-tactile stimulation of normal and tangential skin forces , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Hong Z. Tan,et al.  Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities , 2010, IEEE Transactions on Haptics.

[7]  Julie M. Walker,et al.  [D86] Skin-stretch proprioceptive feedback for a robotic gripper , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[8]  Nikolaos G. Tsagarakis,et al.  Design of a wearable skin stretch cutaneous device for the upper limb , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[9]  Sebastian Müller,et al.  Haptically augmented remote speech communication: a study of user practices and experiences , 2012, NordiCHI.

[10]  J. Wheeler,et al.  Investigation of Rotational Skin Stretch for Proprioceptive Feedback With Application to Myoelectric Systems , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Marc O. Ernst,et al.  A Bayesian view on multimodal cue integration , 2006 .

[12]  Michael D. Byrne,et al.  Toward training surgeons with motion-based feedback: Initial validation of smoothness as a measure of motor learning , 2017 .

[13]  A. A. Gopalai,et al.  A Wearable Real-Time Intelligent Posture Corrective System Using Vibrotactile Feedback , 2011, IEEE/ASME Transactions on Mechatronics.

[14]  Robert H. Gault,et al.  Progress in experiments on tactual interpretation of oral speech. , 1924 .

[15]  Ryan M. Traylor,et al.  A Haptic Back Display for Attentional and Directional Cueing , 2003 .

[16]  William R. Provancher,et al.  Planar Hand Motion Guidance Using Fingertip Skin-Stretch Feedback , 2014, IEEE Transactions on Haptics.

[17]  Hong Z. Tan,et al.  A Two DOF Controller for a Multi-Finger Tactual Display Using a Loop-Shaping Technique , 2004 .

[18]  Sungkil Lee,et al.  Saliency-Driven Real-Time Video-to-Tactile Translation , 2014, IEEE Transactions on Haptics.

[19]  Hanfeng Yuan,et al.  Tactual display of consonant voicing to supplement lipreading , 2005, The Journal of the Acoustical Society of America.

[20]  Timothy Bretl,et al.  Passive Mechanical Skin Stretch for Multiple Degree-of-Freedom Proprioception in a Hand Prosthesis , 2014, EuroHaptics.

[21]  Marcia Kilchenman O'Malley,et al.  The role of auxiliary and referred haptic feedback in myoelectric control , 2015, 2015 IEEE World Haptics Conference (WHC).

[22]  J M Weisenberger,et al.  Relative performance of single-channel and multichannel tactile aids for speech perception. , 1991, Journal of rehabilitation research and development.

[23]  Deborah I. Fels,et al.  Designing the Model Human Cochlea: An Ambient Crossmodal Audio-Tactile Display , 2009, IEEE Transactions on Haptics.

[24]  Marcia Kilchenman O'Malley,et al.  Vibrotactile feedback of pose error enhances myoelectric control of a prosthetic hand , 2013, 2013 World Haptics Conference (WHC).

[25]  C M Reed,et al.  Research on tactile communication of speech: a review. , 1982, ASHA monographs.

[26]  Marcia Kilchenman O'Malley,et al.  Tactile Feedback of Object Slip Facilitates Virtual Object Manipulation , 2015, IEEE Transactions on Haptics.

[27]  Edoardo Battaglia,et al.  The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand , 2017, 2017 IEEE World Haptics Conference (WHC).

[28]  David M. Eagleman,et al.  Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput , 2015, Experimental Brain Research.

[29]  Katherine J. Kuchenbecker,et al.  Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance , 2012, IEEE Transactions on Haptics.