First person movement control with palm normal and hand gesture interaction in virtual reality

Virtual reality (VR) has become a very popular technology in recent years, which used in the field of multimedia for various purposes. One of the applications that widely used for simulating physical presence in the real world is walk-through VR. In the walk-through VR system will generate simulation character or avatar for user which able to control movement, especially first person movement walk-through in VR with many input devices. In this paper, we present a human - computer interaction with the connection of Oculus Rift and Leap Motion new technological devices for VR. Oculus Rift is VR headset or head - mounted display devices that have a small display optic in front of each eye. Oculus Rift can track head movement and change view point follow it. Leap Motion is in - air controller that can track hand gesture of the user. The combination of them will make users feel like immerse to VR. Users can move avatar any way in VR by their hand interact through the system via these devices. We introduce a new interactive hand gesture system with palm normal for control steering develop by the game engine Unity3D applies synchronization of Oculus Rift and Leap Motion. Our design and development method will allow users to adjust moving speed follows the hand gesture and the range of the user's hand that make a smoothly moving with acceleration.

[1]  Gerd Bruder,et al.  Analysis of direct selection in head-mounted display environments , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[2]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[3]  Alistair G. Sutcliffe,et al.  Evaluating the usability of virtual reality user interfaces , 2000, Behav. Inf. Technol..

[4]  S. Blackman.  Beginning 3D Game Development with Unity 4 , 2011 .

[5]  Yoichi Sato,et al.  Real-time input of 3D pose and gestures of a user's hand and its applications for HCI , 2001, Proceedings IEEE Virtual Reality 2001.

[6]  Lakshmi Kurup,et al.  A Review Paper on Oculus Rift & Project Morpheus , 2014 .

[7]  Jeffrey W. Chastine,et al.  A study of gesture-based first person control , 2013, Proceedings of CGAMES'2013 USA.

[8]  Leigh Ellen Potter,et al.  Experiences using emerging technology , 2014, OZCHI.

[9]  Stefan Greuter,et al.  SpaceWalk: Movement and Interaction in Virtual Space with Commodity Hardware , 2014, IE.

[10]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[11]  Lee Garber.  Gestural Technology: Moving Interfaces in a New Direction , 2013, Computer.

[12]  Jens Keil,et al.  Design Criteria for AR-Based Training of Maintenance and Assembly Tasks , 2011, HCI.

[13]  Jun Rekimoto,et al.  GestureWrist and GesturePad: unobtrusive wearable interaction devices , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[14]  Daniel Plemmons,et al.  Creating next-gen 3D interactive apps with motion control and Unity3D , 2014, SIGGRAPH '14.

[15]  Angelos Amditis,et al.  Human centred design of 3-D interaction devices to control virtual environments , 2006, Int. J. Hum. Comput. Stud..

[16]  Sue Blackman,et al.  Beginning 3D Game Development with Unity: All-in-one, multi-platform game development , 2011 .

[17]  Bruce Blumberg.  New Challenges for Character-Based AI for Games , 2002 .