The anthropomorphic flutist robot WF-4R: from mechanical to perceptual improvements

One of the earliest motivations for developing humanoid robots centered on creating robots that may coexist with humans in environments created for human beings. For several years, at Waseda University, the development of the anthropomorphic flutist player has been focused on improving the musical interaction between the human and the robot to clarify the human flute playing and to propose novel assisted music teaching tools. In this paper, a new architecture for autonomously transferring skills from robot to human using the flutist robot is introduced. Furthermore, the new version of the flutist robot, the WF-4R (Waseda Flutist No.4 Refined) is presented; where the arm system was added to assure the positioning accuracy of the flute and the development of a melody recognition system to enable the robot to interact with students at the same logical level of perception. An experimental setup has been performed in order to verify the effectiveness of both mechanical and perceptual systems. As a result, using the arms system, we have assured the repetitiveness of the flute positioning. Furthermore, the implemented music recognition system was able to recognize the melody of flutist players (an overall recognition rate of 90%); demonstrating that HMM (usually used for speech recognition) is also effective for flute melody identification.

[1]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[2]  Massimo Bergamasco,et al.  The anthropomorphic flutist robot WF-4 teaching flute playing to beginner students , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[4]  Brian Scassellati,et al.  Humanoid Robots: A New Kind of Tool , 2000, IEEE Intell. Syst..

[5]  Ulrich Bodenhausen,et al.  A connectionist recognizer for on-line cursive handwriting recognition , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Beth Logan,et al.  Mel Frequency Cepstral Coefficients for Music Modeling , 2000, ISMIR.

[7]  Alex Bateman,et al.  An introduction to hidden Markov models. , 2007, Current protocols in bioinformatics.

[8]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[9]  J. Hollerbach.  An oscillation theory of handwriting , 2004, Biological Cybernetics.

[10]  Massimo Bergamasco,et al.  Evaluating the sound quality of beginner players by an anthropomorphic flutist robot (WF-4) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[11]  Xiaolin Li,et al.  On-line handwritten alphanumeric character recognition using dominant points in strokes , 1997, Pattern Recognit..

[12]  Atsuo Takanishi,et al.  Development of a new anthropomorphic flutist robot WF-4 , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[13]  William M. Hartmann,et al.  Psychoacoustics: Facts and Models , 2001 .

[14]  J. Movellan.  Tutorial on Hidden Markov Models , 2006 .

[15]  Klaus Landzettel,et al.  Tele Sensor Programming - A task-directed programming approach for sensor-based space robots , 1995 .