Development of a Human-Display Interface with Vibrotactile Feedback for Real-World Assistive Applications

It is important to operate devices with control panels and touch screens assisted by haptic feedback in mobile environments such as driving automobiles and electric power wheelchairs. A lot of consideration is needed to give accurate haptic feedback, especially, presenting clear touch feedback to the elderly and people with reduced sensation is a very critical issue from healthcare and safety perspectives. In this study, we aimed to identify the perceptual characteristics for the frequency and direction of haptic vibration on the touch screen with vehicle-driving vibration and to propose an efficient haptic system based on these characteristics. As a result, we demonstrated that the detection threshold shift decreased at frequencies above 210 Hz due to the contact pressure during active touch, but the detection threshold shift increased at below 210 Hz. We found that the detection thresholds were 0.30–0.45 gpeak with similar sensitivity in the 80–270 Hz range. The haptic system implemented by reflecting the experimental results achieved characteristics suitable for use scenarios in automobiles. Ultimately, it could provide practical guidelines for the development of touch screens to give accurate touch feedback in the real-world environment.

[1]  Stephen Brewster,et al.  Investigating the effect of tactile input and output locations for drivers’ hands on in-car tasks performance , 2020, AutomotiveUI.

[2]  Hugo Costelha,et al.  User-Experience with Haptic Feedback Technologies and Text Input in Interactive Multimedia Devices , 2020, Sensors.

[3]  Ravinder Dahiya,et al.  Tacsac: A Wearable Haptic Device with Capacitive Touch-Sensing Capability for Tactile Display , 2020, Sensors.

[4]  Cagatay Basdogan,et al.  A Review of Surface Haptics: Enabling Tactile Effects on Touch Surfaces , 2020, IEEE Transactions on Haptics.

[5]  Fabien Danieau,et al.  Towards Haptic Images: A Survey on Touchscreen-Based Surface Haptics , 2020, IEEE Transactions on Haptics.

[6]  Landry Delphin Chapwouo Tchakouté,et al.  Perception of a Haptic Stimulus Presented Under the Foot Under Workload , 2020, Sensors.

[7]  Ji-Hoon Jeong,et al.  Brain-Controlled Robotic Arm System Based on Multi-Directional CNN-BiLSTM Network Using EEG Signals , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Roberta L Klatzky,et al.  Detection and Identification of Pattern Information on an Electrostatic Friction Display , 2019, IEEE Transactions on Haptics.

[9]  Stella M. Clarke,et al.  A Theoretical Framework of Haptic Processing in Automotive User Interfaces and Its Implications on Design and Engineering , 2019, Front. Psychol..

[10]  Jaeyoung Park,et al.  Effect of Haptic Feedback on the Perceived Size of a Virtual Object , 2019, IEEE Access.

[11]  Weiliang Xu,et al.  Haptic display for virtual reality: progress and challenges , 2019, Virtual Real. Intell. Hardw..

[12]  John Williamson,et al.  A High Performance Spelling System based on EEG-EOG Signals With Visual Feedback , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Seong-Whan Lee,et al.  Commanding a Brain-Controlled Wheelchair Using Steady-State Somatosensory Evoked Potentials , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Klaus-Robert Müller,et al.  Motion-Based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Yuru Zhang,et al.  Speed-accuracy tradeoff of fingertip force control with visual/audio/haptic feedback , 2018, Int. J. Hum. Comput. Stud..

[16]  Stephen A. Brewster,et al.  An Evaluation of Touch and Pressure-Based Scrolling and Haptic Feedback for In-Car Touchscreens , 2017, AutomotiveUI.

[17]  Hyoung Joong Kim,et al.  A High-Security EEG-Based Login System with RSVP Stimuli and Dry Electrodes , 2016, IEEE Transactions on Information Forensics and Security.

[18]  Stephen A. Brewster,et al.  Investigating Pressure Input and Haptic Feedback for In-Car Touchscreens and Touch Surfaces , 2016, AutomotiveUI.

[19]  A. Engel,et al.  The Sense of Agency Is More Sensitive to Manipulations of Outcome than Movement-Related Feedback Irrespective of Sensory Modality , 2016, PloS one.

[20]  Seong-Whan Lee,et al.  Movement intention decoding based on deep learning for multiuser myoelectric interfaces , 2016, 2016 4th International Winter Conference on Brain-Computer Interface (BCI).

[21]  Betty Lemaire-Semail,et al.  Physical and Perceptual Independence of Ultrasonic Vibration and Electrovibration for Friction Modulation , 2015, IEEE Transactions on Haptics.

[22]  Geehyuk Lee,et al.  Haptic feedback design for a virtual button along force-displacement curves , 2013, UIST.

[23]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[24]  Manlai You,et al.  Direct-touch vs. mouse input for navigation modes of the web map , 2011, Displays.

[25]  Hong Z. Tan,et al.  Design and Evaluation of Identifiable Key-Click Signals for Mobile Devices , 2011, IEEE Transactions on Haptics.

[26]  Wonil Hwang,et al.  Vibration perception and excitatory direction for haptic devices , 2011, J. Intell. Manuf..

[27]  Jochen Rick,et al.  Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop , 2010, UIST.

[28]  Bruce Banter,et al.  Touch Screens and Touch Surfaces are Enriched by Haptic Force‐Feedback , 2010 .

[29]  Topi Kaaresoja,et al.  Feel-good touch: finding the most pleasant tactile feedback for a mobile touch screen button , 2008, ICMI '08.

[30]  Ju-Hwan Lee,et al.  Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions , 2008, BCS HCI.

[31]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[32]  Ali Israr,et al.  Mechanical Impedance of the Hand Holding a Spherical Tool at Threshold and Suprathreshold Stimulation Levels , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[33]  Linda R. Elliott,et al.  Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis , 2006, ICMI '06.

[34]  H. Tan,et al.  Frequency and amplitude discrimination along the kinestheticcutaneous continuum in the presence of masking stimuli. , 2006, The Journal of the Acoustical Society of America.

[35]  Ali Israr,et al.  Detection Threshold and Mechanical Impedance of the Hand in a Pen-Hold Posture , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[37]  M. Griffin,et al.  Thresholds for the perception of hand-transmitted vibration: Dependence on contact area and contact location , 2005, Somatosensory & motor research.

[38]  Sharif Razzaque,et al.  Tactile virtual buttons for mobile devices , 2003, CHI Extended Abstracts.

[39]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[40]  Eckardt Johanning,et al.  Whole-body vibration exposure study in U.S. railroad locomotives--an ergonomic risk assessment. , 2002, AIHA journal : a journal for the science of occupational and environmental health and safety.

[41]  M. Leek.  Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[42]  Toshiaki Sugimura,et al.  Active click: tactile feedback for touch panels , 2001, CHI Extended Abstracts.

[43]  S S Hsiao,et al.  Detection of vibration transmitted through an object grasped in the hand. , 1999, Journal of neurophysiology.

[44]  Peter Grigg,et al.  Noise-mediated enhancements and decrements in human tactile sensation , 1997 .

[45]  H. Levitt.  Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[46]  R. T. Verrillo.  TEMPORAL SUMMATION IN VIBROTACTILE SENSITIVITY. , 1965, The Journal of the Acoustical Society of America.

[47]  J. Zwislocki.  Theory of Temporal Auditory Summation , 1960 .

[48]  Stefano Papetti,et al.  Vibrotactile Sensitivity in Active Touch: Effect of Pressing Force , 2017, IEEE Transactions on Haptics.

[49]  Lee Skrypchuk,et al.  Visual-haptic feedback interaction in automotive touchscreens , 2012, Displays.

[50]  Emilia Koskinen,et al.  Optimizing Tactile Feedback for Virtual Buttons in Mobile Devices , 2008 .

[51]  Volker Mellert,et al.  Vibration thresholds and equal vibration levels at the human fingertip and palm , 2003 .

[52]  K. J. Kuchenbecker,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Improving Contact Realism through Event-based Haptic Feedback , 2022 .