Haptic Systems in User Interfaces: State of the Art Survey

Over the past decade, the advancements in force-feedback (haptic) systems, facilitated the inclusion of the tactile communication channel in a variety of user interfaces. Tactile sensors are distributed over the entire human body, hence a diversity of haptic hardware configurations are possible. The applications span from: force-feedback systems - conveying large forces, to vibrotactile systems - conveying smaller forces to the human sensory system. This paper provides a comprehensive survey of state-of-the-art in force-feedback and vibrotactile hardware with references to associated software. The main application domains, several prominent applications, as well as significant research efforts are highlighted. Additionally the survey defines the terms and the paradigms used in the haptic technology domain.

[1]  Hye Rin Kwag,et al.  Stimuli-responsive theragrippers for chemomechanical controlled release. , 2014, Angewandte Chemie.

[2]  Hendrik P. Buimer,et al.  Conveying facial expressions to blind and visually impaired persons through a wearable vibrotactile device , 2018, PloS one.

[3]  Claudio Pacchierotti,et al.  Rendering of Pressure and Textures Using Wearable Haptics in Immersive VR Environments , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[4]  Janelle P. Clark,et al.  Reflection on System Dynamics Principles Improves Student Performance in Haptic Paddle Labs , 2018, IEEE Transactions on Education.

[5]  Felix G. Hamza-Lup,et al.  Interactive X-ray and proton therapy training and simulation , 2015, International Journal of Computer Assisted Radiology and Surgery.

[6]  Stefano Scheggi,et al.  Stimuli-Responsive Soft Untethered Grippers for Drug Delivery and Robotic Surgery , 2017, Front. Mech. Eng..

[7]  Felix G. Hamza-Lup,et al.  Web3D graphics enabled through sensor networks for cost-effective assessment and management of energy efficiency in buildings , 2016, Graph. Model..

[8]  Francesco Caltagirone,et al.  Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces , 2018, ArXiv.

[9]  Serdar Çağlak.  Does Hands-on Science Practices Make an Impact on Achievement in Science? A Meta-Analysis , 2016 .

[10]  Leonardo Meli,et al.  The hBracelet: A Wearable Haptic Device for the Distributed Mechanotactile Stimulation of the Upper Limb , 2018, IEEE Robotics and Automation Letters.

[11]  Cagdas D. Onal,et al.  A Soft Robotic Wearable Wrist Device for Kinesthetic Haptic Feedback , 2018, Front. Robot. AI.

[12]  Dorin M. Popovici,et al.  Haptic Feedback Systems in Medical Education , 2018, ArXiv.

[13]  Muhammad Afif Bin Husman.  A Haptic Feedback System for Lower Limb Amputees Based on Gait Event Detection , 2017 .

[14]  Paul Tucan,et al.  Development of a parallel robotic system for transperineal biopsy of the prostate , 2017 .

[15]  Mohamed E. M. K. Abdelaziz,et al.  Controlling the Stormram 2: An MRI-compatible robotic system for breast biopsy , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Nick Bryan-Kinns,et al.  Mood Glove: A haptic wearable prototype system to enhance mood music in film , 2016, Entertain. Comput..

[17]  Maria Teresa Restivo,et al.  Haptic interaction with virtual interface to learn strength of materials , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[18]  Claudio Pacchierotti,et al.  Steering and Control of Miniaturized Untethered Soft Magnetic Grippers With Haptic Assistance , 2018, IEEE Transactions on Automation Science and Engineering.

[19]  A. Kalloo,et al.  Biopsy with Thermally‐Responsive Untethered Microtools , 2013, Advanced materials.

[20]  Lynette A. Jones,et al.  Shape Localization and Recognition Using a Magnetorheological-Fluid Haptic Display , 2018, IEEE Transactions on Haptics.

[21]  Anne Marie Piper,et al.  Haptic explorers: Supporting science journaling through mobile haptic feedback displays , 2019, Int. J. Hum. Comput. Stud..

[22]  Felix G. Hamza-Lup,et al.  Simulating Forces - Learning Through Touch, Virtual Laboratories , 2019, ArXiv.

[23]  Ulf Sellgren,et al.  Design optimization of haptic device - A systematic literature review , 2017 .

[24]  Eyal Ofek,et al.  Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller , 2018, CHI.

[25]  Thenkurussi Kesavadas,et al.  Surgeon Training in Telerobotic Surgery via a Hardware-in-the-Loop Simulator , 2017, Journal of healthcare engineering.

[26]  George Ghinea,et al.  ForceTab: Visuo-haptic interaction with a force-sensitive actuated tablet , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[27]  Abdulmotaleb El Saddik,et al.  Artificial and Virtual Impedance Interaction Force Reflection-Based Bilateral Shared Control for Miniature Unmanned Aerial Vehicle , 2019, IEEE Transactions on Industrial Electronics.

[28]  Takamichi Nakamoto,et al.  Olfactory Display Based on Sniffing Action , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[29]  Robert Richer,et al.  Promoting relaxation using virtual reality, olfactory interfaces and wearable EEG , 2018, 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[30]  Klaus Scheffler,et al.  An MR-Compatible Haptic Interface With Seven Degrees of Freedom , 2018, IEEE/ASME Transactions on Mechatronics.

[31]  Panagiotis Polygerinos,et al.  Soft Robotic Haptic Interface with Variable Stiffness for Rehabilitation of Neurologically Impaired Hand Function , 2017, Front. Robot. AI.

[32]  Shuguo Wang,et al.  Design of a new haptic device and experiments in minimally invasive surgical robot , 2017, Computer assisted surgery.

[33]  Amy Zhang,et al.  A user-centered design and analysis of an electrostatic haptic touchscreen system for students with visual impairments , 2018, Int. J. Hum. Comput. Stud..

[34]  Esteban Walter Gonzalez Clua,et al.  Haptic forces and gamification on epidural anesthesia skill gain , 2018, Entertain. Comput..

[35]  Gabriel Zachmann,et al.  A Virtual Hip Replacement Surgery Simulator with Realistic Haptic Feedback , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[36]  Sebastiaan M. Petermeijer,et al.  Take-over requests in highly automated driving: A crowdsourcing survey on auditory, vibrotactile, and visual displays , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.

[37]  Roger B. Dannenberg,et al.  ShIFT: A Semi-haptic Interface for Flute Tutoring , 2018, NIME.

[38]  Tovi Grossman,et al.  HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow , 2018, UIST.

[39]  Michael Rohs,et al.  Squeezeback: Pneumatic Compression for Notifications , 2017, CHI.

[40]  Felix G. Hamza-Lup,et al.  Haptics-Augmented Physics Simulation: Coriolis Effect , 2019, ArXiv.

[41]  Wanjoo Park,et al.  A Vibrotactile Alarm System for Pleasant Awakening , 2018, IEEE Transactions on Haptics.

[42]  Antoine Ferreira,et al.  Macro-micromanipulation platform for inner ear drug delivery , 2018, Robotics Auton. Syst..

[43]  Antonio Frisoli,et al.  Wearable Haptics and Immersive Virtual Reality Rehabilitation Training in Children With Neuromotor Impairments , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  F. Maxwell Harper,et al.  Early Lessons from a Voice-Only Interface for Finding Movies , 2018, ArXiv.

[45]  Allison M. Okamura,et al.  Open source, modular, customizable, 3-D printed kinesthetic haptic devices , 2017, 2017 IEEE World Haptics Conference (WHC).

[46]  Claudio Pacchierotti,et al.  A Wearable Haptic System for the Health Monitoring of Elderly People in Smart Cities , 2018, Int. J. Online Eng..

[47]  Takahiro Nozaki,et al.  Artificial Replacement of Human Sensation Using Haptic Transplant Technology , 2018, IEEE Transactions on Industrial Electronics.

[48]  Mohamad A. Eid,et al.  Towards a realistic haptic-based dental simulation , 2017, 2017 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE).

[49]  Felix G. Hamza-Lup.  Kinesthetic Learning - Haptic User Interfaces for Gyroscopic Precession Simulation , 2019, ArXiv.

[50]  Arianna Menciassi,et al.  Neuromorphic Vibrotactile Stimulation of Fingertips for Encoding Object Stiffness in Telepresence Sensory Substitution and Augmentation Applications , 2018, Sensors.

[51]  Jindong Tan,et al.  Dynamics Modeling and Analysis of a Swimming Microrobot for Controlled Drug Delivery , 2006, IEEE Transactions on Automation Science and Engineering.

[52]  Roy George,et al.  The need for virtual reality simulators in dental education: A review , 2017, The Saudi dental journal.

[53]  Felix G. Hamza-Lup,et al.  The haptic paradigm in education: Challenges and case studies , 2018, Internet High. Educ..

[54]  G. Andreoni,et al.  Wearable haptic-feedback navigational assistance for people with dementia: Preliminary assessment , 2017 .

[55]  M. Srinivasan.  What is Haptics ? , 2022 .

[56]  Yan Wang,et al.  Haptic based teleoperation with master-slave motion mapping and haptic rendering for space exploration , 2019, Chinese Journal of Aeronautics.

[57]  Shuxiang Guo,et al.  Magnetorheological Fluids Actuated Haptic-Based Teleoperated Catheter Operating System , 2018, Micromachines.

[58]  P. Bachman,et al.  Investigation of Electrohydraulic Drive Control System with the Haptic Joystick , 2018 .

[59]  Chris Melhuish,et al.  Design of a Wearable Fingertip Haptic Device for Remote Palpation: Characterisation and Interface with a Virtual Environment , 2018, Front. Robot. AI.

[60]  Amin Termehyousefi,et al.  Development of haptic based piezoresistive artificial fingertip: Toward efficient tactile sensing systems for humanoids. , 2017, Materials science & engineering. C, Materials for biological applications.