Non-Verbal Communication for a Virtual Reality Interface

The steady growth of technology has allowed to extend all forms of human-computer communication. Since the emergence of more sophisticated interaction devices, Human Computer Interaction (HCI) science has added the issue of Non-Verbal Communication (NVC). Nowadays, there are a lot of applications such as interactive entertainments and virtual reality requiring more natural and intuitive interfaces. Human gestures constitute a great space of actions expressed by the body, face, and/or hands. Hand Gesture is frequently used in people’s daily life, thus it is an alternative form to communicate with computers in an easy way. This paper introduces a real-time hand gesture recognition and tracking system to identify different and dinamic hand postures. In order to improve the user experience, a set of different system functions into a virtual world had been implemented so interaction can be performed by the user through a data glove device.

[1]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[2]  Richard N. Van Eck Interdisciplinary Models and Tools for Serious Games: Emerging Concepts and Future Directions , 2010 .

[3]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Carla Maria Dal Sasso Freitas,et al.  Cooperative object manipulation in collaborative virtual environments , 2008, Journal of the Brazilian Computer Society.

[5]  Mel Slater,et al.  Non-verbal Communication for Correlational Characters , 2005 .

[6]  Antonio Camurri,et al.  Gesture-Based Communication in Human-Computer Interaction , 2003, Lecture Notes in Computer Science.

[7]  Francois Dominic Laramee,et al.  Game Design Perspectives , 2002 .

[8]  Fabri,et al.  Expressive Agents : Non-verbal Communication in Collaborative Virtual Environments , 2002 .

[10]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[11]  Jacqueline Fernández,et al.  A virtual reality computing platform for real time 3D visualization , 2012 .

[12]  Mohamed Alsheakhali,et al.  Hand Gesture Recognition System , 2011 .

[13]  Natural User Interfaces in Mobile Phone Interaction , 2010 .

[14]  Angélica de Antonio Jiménez,et al.  Nonverbal Communication to Support Collaborative Interaction in Collaborative Virtual Environments for Learning , 2008 .

[15]  A. B. M. Shawkat Ali,et al.  HMM based hand gesture recognition: A review on techniques and approaches , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[16]  Francisco González,et al.  Fallbox: a computer game with natural interaction through head tracking , 2010 .

[17]  Quang Nguyen,et al.  Human Computer Interaction Using Hand Gestures , 2014, ICIC.

[18]  Hanqing Lu,et al.  A real-time hand gesture recognition method , 2007, 2011 International Conference on Electronics, Communications and Control (ICECC).

[19]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.