Virtual Muscle Force: Communicating Kinesthetic Forces Through Pseudo-Haptic Feedback and Muscle Input

Natural haptic feedback in virtual reality (VR) is complex andchallenging, due to the intricacy of necessary stimuli and re-spective hardware. Pseudo-haptic feedback aims at providinghaptic feedback without providing actual haptic stimuli butby using other sensory channels (e.g. visual cues) for feed-back. We combine such an approach with the additional inputmodality of muscle activity that is mapped to a virtual force toinfluence the interaction flow. In comparison to existing approaches as well as to no kines-thetic feedback at all the presented solution significantly in-creased immersion, enjoyment as well as the perceived qualityof kinesthetic feedback.

[1]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[2]  J.C. Perry,et al.  Upper-Limb Powered Exoskeleton Design , 2007, IEEE/ASME Transactions on Mechatronics.

[3]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[4]  Olivier Martin,et al.  HEMP - hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis , 2009, Int. J. Hum. Comput. Stud..

[5]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[6]  Haruhisa Kawasaki,et al.  Five-fingered haptic interface robot: HIRO III , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[7]  Enrico Rukzio,et al.  Breaking the Tracking: Enabling Weight Perception using Perceivable Tracking Offsets , 2018, CHI.

[8]  Daniel Freedman,et al.  Reality Skins: Creating Immersive and Tactile Virtual Environments , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[9]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[10]  Olivier Martin,et al.  HEMP-Hand-Displacement-Based Pseudo-Haptics: A Study of a Force Field Application , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[11]  Yoshifumi Kitamura,et al.  Current trends in 3D user interface research , 2009, Int. J. Hum. Comput. Stud..

[12]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[13]  Antonio Krüger,et al.  Same-side Hand Interactions with Arm-placed Devices Using EMG , 2015, CHI Extended Abstracts.

[14]  Pedro Lopes,et al.  Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation , 2015, UIST.

[15]  Anatole Lécuyer,et al.  A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes , 2008, TAP.

[16]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[17]  Farzam Farbiz,et al.  An electrical muscle stimulation haptic feedback for mixed reality tennis game , 2007, SIGGRAPH '07.

[18]  Kodak.  Ergonomic Design for People at Work , 1989 .

[19]  Luv Kohli,et al.  Redirected touching: Warping space to remap passive haptics , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[20]  Laurent Étienne,et al.  Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures , 2004, CHI.

[21]  Henry Sowizral,et al.  Implementation of Dynamic Robotic Graphics For a Virtual Control Panel , 1997, Presence: Teleoperators & Virtual Environments.

[22]  Robert G. Radwin,et al.  Virtual exertions: A user interface combining visual information, kinesthetics and biofeedback for virtual object manipulation , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[23]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[24]  Pedro Lopes,et al.  Muscle-propelled force feedback: bringing force feedback to mobile devices , 2013, CHI.

[25]  EndoTakahiro,et al.  Five-Fingered Haptic Interface Robot , 2011 .

[26]  Enrico Rukzio,et al.  Demo of the Matrix Has You: Realizing Slow Motion in Full-Body Virtual Reality , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[27]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Hirooki Aoki.  Muscle Activity Resulting from Pseudo-haptic Occurrences , 2018, 2018 12th France-Japan and 10th Europe-Asia Congress on Mechatronics.

[29]  Ipke Wachsmuth,et al.  The Visual, the Auditory and the Haptic - A User Study on Combining Modalities in Virtual Worlds , 2013, HCI.

[30]  Michael Rohs,et al.  Cruise Control for Pedestrians: Controlling Walking Direction using Electrical Muscle Stimulation , 2015, CHI.

[31]  Tsuneo Yoshikawa,et al.  Mechano-Media that Transmit Kinesthetic Knowledge from a Human to Other Humans , 2001, ISRR.

[32]  Mathieu Nancel,et al.  Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors , 2015, CHI.

[33]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[34]  Robert G. Radwin,et al.  Virtual Exertions , 2015, Hum. Factors.

[35]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[36]  Eric Burns,et al.  Combining passive haptics with redirected walking , 2005, ICAT '05.

[37]  BurkhardtJean-Marie,et al.  A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes , 2008 .

[38]  Kongqiao Wang,et al.  Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors , 2009, IUI.

[39]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[40]  Regan L. Mandryk,et al.  Biofeedback game design: using direct and indirect physiological control to enhance game interaction , 2011, CHI.

[41]  Shoichi Hasegawa,et al.  SPIDAR G&G: A Two-Handed Haptic Interface for Bimanual VR Interaction , 2004 .

[42]  Susumu Tachi,et al.  ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation , 2010, AH.

[43]  Makoto Sato,et al.  A novel interaction system with force feedback between real - and virtual human: an entertainment system: "virtual catch ball" , 2004, ACE '04.

[44]  Elisabeth André,et al.  EMG-based hand gesture recognition for realtime biosignal interfacing , 2008, IUI '08.

[45]  J. Blake,et al.  Haptic Glove With MR Brakes for Virtual Reality , 2009, IEEE/ASME Transactions on Mechatronics.

[46]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[47]  Anatole Lécuyer,et al.  "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system , 2001, Proceedings IEEE Virtual Reality 2001.

[48]  Grigore C. Burdea,et al.  Virtual reality simulation modeling for a haptic glove , 1999, Proceedings Computer Animation 1999.

[49]  Julian Frommel,et al.  Conveying the Perception of Kinesthetic Feedback in Virtual Reality using State-of-the-Art Hardware , 2018, CHI.

[50]  Jun Rekimoto,et al.  PossessedHand: techniques for controlling human hands using electrical muscles stimuli , 2011, CHI.

[51]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[52]  Hunter G. Hoffman,et al.  Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[53]  Elia Gatti,et al.  Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio , 2019, CHI.

[54]  John Sullivan,et al.  Flex: hand gesture recognition using muscle flexing sensors , 2017, SUI.

[55]  Thijs Roumen,et al.  TurkDeck: Physical Virtual Reality Based on People , 2015, UIST.