Real-Time Virtual Lego Brick Manipulation Based on Hand Gesture Recognition

Recently, with the development of interactive virtual reality technology, many devices have been created to serve the purpose of helping people interact with virtual objects accurately and meticulously. Leap Motion, one of the new devices developed recently, not only supports some basic gestures, but also provides enough information so that developers can define their own gestures. In this paper, we present a 3D simulation which is quite similar to real Lego products using VR technology and Leap Motion. Players can perform simple actions like assembling, changing color, rotating Lego bricks, and zooming in and out. They can also control GUI easily through hand gestures that are analyzed and processed inside the system.

[1]  Zhongke Wu,et al.  GPU-Based Realtime Hand Gesture Interaction and Rendering for Volume Datasets Using Leap Motion , 2014, 2014 International Conference on Cyberworlds.

[2]  Sung-Tae Jung,et al.  Real-time gesture recognition using 3D depth camera , 2011, 2011 IEEE 2nd International Conference on Software Engineering and Service Science.

[3]  Doug A. Bowman,et al.  Slice-n-Swipe: A free-hand gesture user interface for 3D point cloud annotation , 2014, 3DUI.

[4]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[5]  Thomas Bock,et al.  Intuitive and Adaptive Robotic Arm Manipulation using the Leap Motion Controller , 2014, ISR 2014.

[6]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[7]  Christian Stolte,et al.  The Molecular Control Toolkit: Controlling 3D molecular graphics via gesture and voice , 2013, 2013 IEEE Symposium on Biological Data Visualization (BioVis).

[8]  Wei Song,et al.  Gesture-Based NUI Application for Real-Time Path Modification , 2013, 2013 IEEE 11th International Conference on Dependable, Autonomic and Secure Computing.

[9]  Yi Li,et al.  Multi-scenario gesture recognition using Kinect , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[10]  Janusz Konrad,et al.  Dynamic time warping for gesture-based user identification and authentication with Kinect , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.