Haptic interface to Di-Guy

Much of the state-of-the-art commercial simulation software focuses on providing realistic animations and convincing artificial intelligence to avatars within a scenario. Research on enhancing the interactivity and immersion of such simulation is not generally as highly refined. Based on the research of our user-study, we identify that it is desirable for simulation software to have improved interaction between users and the scenario. The more intuitive interactions that the system has, the better the immersive experience will be. Based on this idea, we propose a pipeline to effectively integrate haptic interactions into the DI-Guy simulation environment, with the goal of improving user interactivity with the avatars in the scenario. By implementing such a pipeline, simulation packages will be capable of not only enhancing control over certain actions of avatars, but also providing realistic force feedback to the user. Unlike typical haptic integration approach which is based on high-level libraries and existing haptic collision detection and force rendering algorithms, we implement our own novel algorithm based on the fact we do not have direct access to low-level primitives such as vertices and normals in the virtual environment. Besides, we also implemented our own vendor-independent middleware as a part of our algorithm to provide a generic solution for integration of natural interfaces such as haptics and 3D space mouse with commercial software to enable the building of a complete immersive virtual training system.

[1]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[2]  Michael Luck,et al.  Applying artificial intelligence to virtual reality: Intelligent virtual environments , 2000, Appl. Artif. Intell..

[3]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[4]  S. Nahavandi,et al.  OzBotTM -haptic augmentation of a teleoperated robotic platform for search and rescue operations , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[5]  Mehdi Ammi,et al.  VR-CAD integration: Multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models , 2010, Comput. Aided Des..

[6]  Alan Wexelblat,et al.  Virtual reality applications and explorations , 1993 .

[7]  Roman Vlasov,et al.  Ray casting for collision detection in haptic rendering of volume data , 2012, I3D '12.

[8]  Clay Wilson Improvised Explosive Devices in Iraq: Effects and Countermeasures , 2005 .

[9]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[10]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[11]  Raul Wirz,et al.  Haptic Rendering Methods for Multiple Contact Points , 2012, Immersive Multimodal Interactive Presence.

[12]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[13]  Makoto Sato,et al.  Integration of Physics Based Simulation with Haptic Interfaces for VR Applications , 2005 .

[14]  El Saddik,et al.  The Potential of Haptics Technologies , 2007, IEEE Instrumentation & Measurement Magazine.

[15]  S. Botden,et al.  The importance of haptic feedback in laparoscopic suturing training and the additive value of virtual reality simulation , 2008, Surgical Endoscopy.

[16]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[17]  Robert J. Stone,et al.  Haptic Feedback: A Brief History from Telepresence to Virtual Reality , 2000, Haptic Human-Computer Interaction.

[18]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[19]  Mark Billinghurst Review of Virtual reality technology (2nd Edition) by Grigore Burdea and Philippe Coiffet, Wiley-Interscience , 2003 .

[20]  Rajit Gadh,et al.  Multi-sensory user interface for a virtual-reality-based computer-aided design system , 1997, Comput. Aided Des..

[21]  Frederick P. Brooks What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[22]  Ben Horan,et al.  A multi-point haptic platform for grasping and manipulating virtual objects , 2011, VR 2011.

[23]  Steve Wheeler,et al.  Second Life: an overview of the potential of 3-D virtual worlds in medical and health education. , 2007, Health information and libraries journal.

[24]  John Kenneth Salisbury,et al.  Phantom-Based Haptic Interaction with Virtual Objects , 1997, IEEE Computer Graphics and Applications.

[25]  Clay Wilson,et al.  Improvised Explosive Devices (IEDs) in Iraq and Afghanistan: Effects and Countermeasures , 2006 .

[26]  Rod McCall,et al.  Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution , 2011, PRESENCE: Teleoperators and Virtual Environments.