Usability Study of Static/Dynamic Gestures and Haptic Input as Interfaces to 3D Games

In this paper, the quality of the interaction of users with a 3D game using different modalities is studied. Three different interaction methods with a 3D virtual environment are considered: a haptic 3D mouse, natural static gestures (postures), and natural dynamic (kinetics) gestures. Through a comprehensive user experiment we compared the pre-defined natural gestures to each other and also to a haptic interface which is designed for the same game. The experiments analyze precision (error), efficiency (time), ease-of-use, pleasantness, fatigue, naturalness, mobility, and overall satisfaction as evaluation criteria. We also used user-selected ranks of importance as weight values for evaluation criteria to measure the overall satisfaction. Finally, our user experiment presents a learning curve for each of the three input methods which along with the other findings can be a good source for further research in the field of natural multimodal Human-Computer Interaction. Keywords— Usability study, static/dynamic gestures, haptics, 3D game, human factors.

[1]  Gregory D. Hager,et al.  Applying vision to intelligent human-computer interaction , 2006 .

[2]  T. Baumgartner.  Reading Statistics and Research (5th ed.) , 2008 .

[3]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vincent Hayward,et al.  Tactile Display Device Using Distributed Lateral Skin Stretch , 2000, Dynamic Systems and Control: Volume 2.

[5]  Norman H. Villaroman,et al.  Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor , 2011, SIGITE '11.

[6]  Moniruzzaman Bhuiyan,et al.  A Gesture Controlled User Interface for Inclusive Design and Evaluative Study of Its Usability , 2011, J. Softw. Eng. Appl..

[7]  Christopher R. Wagner,et al.  A tactile shape display using RC servomotors , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[8]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[9]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[10]  Frank Tendick,et al.  A Critical Study of the Mechanical and Electrical Properties of the PHANToM Haptic Interface and Improvements for Highperformance Control , 2002, Presence: Teleoperators & Virtual Environments.

[11]  Ali Arya,et al.  Empirical study of a vision-based depth-sensitive human-computer interaction system , 2012, APCHI '12.

[12]  A. Lecours,et al.  The Biological foundations of gestures : motor and semiotic aspects , 1986 .

[13]  M. Srinivasan.  What is Haptics ? , 2022 .

[14]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[15]  Du-Sik Park,et al.  3D remote interface for smart displays , 2011, CHI EA '11.