A real-time virtual piano based on gesture capture data

Human-computer interaction (HCI) continues to be a significant field of computer industry. Researchers are looking for the next generation human-computer interaction which is more natural and more efficient. As a new device of high precision real-time, Leap Motion could track the movement of hands and fingers, which attracts many researchers attention. In this paper, a new entertainment application C virtual piano C is implemented combined with Unity which is one of the famous game engines, and Leap Motion. The virtual piano in this paper allow users play piano in real-time by moving theirs hands above the Leap Motion controller. Finally, the practice shows that this virtual piano application has a good performance.

[1]  P. Phasukkit,et al.  Hand postures for evaluating trigger finger using leap motion controller , 2015, 2015 8th Biomedical Engineering International Conference (BMEiCON).

[2]  Mikel Sagardia,et al.  A virtual piano-playing environment for rehabilitation based upon ultrasound imaging , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[3]  Tapio Takala,et al.  Experiments with Virtual Reality Instruments , 2005, NIME.

[4]  Anton Nijholt,et al.  Developing a virtual piano playing environment , 2002 .

[5]  Timothy K. Shih,et al.  Real-Time Finger Tracking for Virtual Instruments , 2014, 2014 7th International Conference on Ubi-Media Computing and Workshops.