A Desktop Virtual Reality System with Physical Animation and Glove Interaction

This paper describes the on-going development of a desktop virtual reality system which offers real-time user interaction and realistic physics-based animation of rigid objects. The system is built upon a graphical engine which supports scene graphs, and a physics-based engine which enables collision detection. Full hand pose estimation is achieved through a dataglove and motion tracker. Motion of the user’s hand is coupled to a 3D model of the human hand. A virtual grasping algorithm ensures stability and allows manipulation tasks to be performed even on complex shapes such as triangle meshes. The system supports ballistic motion of falling objects and models grasped objects with a spring-damper scheme. Moreover, vibratory output is generated as feedback to the user.

[1]  Michitaka Hirose,et al.  Dexterous object manipulation based on collision response , 2003, IEEE Virtual Reality, 2003. Proceedings..

[2]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[3]  Judy M. Vance,et al.  Desktop haptic virtual assembly using physically based modelling , 2007, Virtual Reality.

[4]  Michael F. Zaeh,et al.  Haptic Interaction with a Glove Interface in a Physics Based Virtual Environment , 2004 .

[5]  Yong Wang,et al.  Methods and Algorithms for Constraint-based Virtual Assembly , 2003, Virtual Reality.

[6]  Christoph W. Borst,et al.  Realistic virtual grasping , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[7]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[8]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[9]  M. Bergamasco,et al.  A realistic approach for grasping and moving virtual objects , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[10]  Daniel Thalmann,et al.  Multi-finger manipulation of virtual objects , 1996, VRST.

[11]  Helge J. Ritter,et al.  Experience-based and tactile-driven dynamic grasp control , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  H. Sun,et al.  Two-handed assembly with immersive task planning in virtual reality , 2005, Virtual Reality.

[13]  George Baciu,et al.  Physics-based virtual-hand picking in robotic manipulation , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[14]  Li Jinfang,et al.  Data-Glove Based Interactive Training System for Virtual Delivery Operation , 2007, Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007).

[15]  Yang Luo,et al.  Realistic virtual hand modeling with applications for virtual grasping , 2004, VRCAI '04.

[16]  Wan Huagen,et al.  Virtual grasping for virtual assembly tasks , 2004, Third International Conference on Image and Graphics (ICIG'04).