A Gesture Interface based on Hologram and Haptics Environments for Interactive and Immersive Experiences

ABSTRACT This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.Keywords : Gesture Recognition(동작인식), Hologram(홀로그램), Haptics(햅틱), User Interaction(사용자 상호작용), Immersion(몰입감) Received: Dec. 22, 2014 Revised: Jan. 27, 2015Accepted: Feb. 11, 2015Corresponding Author: Jinho Park(Soongsil University)E-mail: c2alpha@ssu.ac.krISSN: 1598-4540 / eISSN: 2287-8211Ⓒ The Korea Game Society. All rights reserved. This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.otg/licenses/by-nc/3.0), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

[1]  Sun-Kyung Kang,et al.  Development of gesture recognition-based serious games , 2012, Proceedings of 2012 IEEE-EMBS International Conference on Biomedical and Health Informatics.

[2]  Kourosh Khoshelham,et al.  Accuracy analysis of kinect depth data , 2012 .

[3]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[4]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[5]  Domenico Prattichizzo,et al.  Using Kinect for hand tracking and rendering in wearable haptics , 2011, 2011 IEEE World Haptics Conference.

[6]  Kanad K. Biswas,et al.  Gesture recognition using Microsoft Kinect® , 2011, The 5th International Conference on Automation, Robotics and Applications.

[7]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Chang-Ik Jang.  A Study of the Physical Experience Using Serious Game Design Traffic Safety Education for Children applied using 3D Depth Gesture Recognition Technology , 2012 .

[9]  Sanjeev Sofat,et al.  Vision Based Hand Gesture Recognition , 2009 .

[10]  Cristina Manresa-Yee,et al.  Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2009, Progress in Computer Vision and Image Analysis.