Human forces in hands free interaction: a new paradigm for immersive virtual environments

A recent trend in virtual environments aims at making the user free of devices or limitations in its motion, at the benefit of immersiveness and interactivity. This work introduces an interaction paradigm that goes beyond motion based interaction, by making use of measured real forces exerted by the user in free space. The sensation of touch with virtual object is obtained by vibrotactile stimulation combining virtual contact information with measured forces. In this way the user has an additional dimension of interactivity at the benefit of immersivity, without incurring in the reduction of sense of presence introduced by grounded haptic interfaces. This paradigm is presented and discussed in particular in the context of a boxing training simulation, as one of the possible application scenarios.

[1]  Koji Tsukada,et al.  ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation , 2004, UbiComp.

[2]  Massimo Bergamasco,et al.  Lowering the development time of multimodal interactive application: the real-life experience of the XVR project , 2005, ACE '05.

[3]  Tom G. Zimmerman,et al.  A hand gesture interface device , 1987, CHI '87.

[4]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[5]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[6]  P. König,et al.  Beyond sensory substitution—learning the sixth sense , 2005, Journal of neural engineering.

[7]  G. Gini,et al.  An EMG-controlled exoskeleton for hand rehabilitation , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[8]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[9]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[10]  Norman I. Badler,et al.  Virtual Training via Vibrotactile Arrays , 2008, PRESENCE: Teleoperators and Virtual Environments.

[11]  Michitaka Hirose,et al.  Implementation of Electromyogram Interface in CABIN Immersive Multiscreen Display , 2006, IEEE Virtual Reality Conference (VR 2006).

[12]  S. Kousidou,et al.  Assistive Exoskeleton for Task Based Physiotherapy in 3-Dimensional Space , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[13]  Francesca Gelli,et al.  Relation between isometric muscle force and surface EMG in intrinsic hand muscles as function of the arm geometry , 2007, Brain Research.

[14]  Makoto Sato,et al.  Effect of Coupling Haptics and Stereopsis on Depth Perception in Virtual Environment , 2000 .

[15]  Pradeep K. Khosla,et al.  Psychophysical Characterization and Testbed Validation of a Wearable Vibrotactile Glove for Telemanipulation , 2003, Presence: Teleoperators & Virtual Environments.

[16]  Carolina Cruz-Neira,et al.  Cyclone Uppercut, a boxing game for an immersive environment , 2005, ACE '05.

[17]  Christine K. Thomas,et al.  Motor unit firing rates during isometric voluntary contractions performed at different muscle lengths. , 2004, Canadian journal of physiology and pharmacology.

[18]  Marino,et al.  "Cluster-based rendering of complex virtual environments." , 2007 .