Keyboard Solo System using a Real Time Hand Recognition Method

As parents are interested in music education for infants in these days, they require systems to help these infants to actively play music. In this paper, we propose a keyboard solo system using a real time hand recognition method. In order to enable the infants to use the system easily, the proposed system plays some sounds whenever the infants move their fingers on a paper piano. For the purpose of minimizing cost to play music, the proposed system utilizes a general PC with only a paper piano, a web camera, and a speaker. With the aim of precisely and efficiently recognizing both a hand and each key on keyboard, the proposed system divides a recognition step into a hand recognition step and a keyboard recognition step. Also, the hand recognition step considers only skin color, and the keyboard recognition step considers only black and white without other colors.