Musical interactions with a perceptual robotic percussionist

We present our approach for human-robot musical interaction using a perceptual and socially-oriented robotic percussionist. Our robot, named Haile, listens to live players, analyzes perceptual musical aspects in real-time, and uses the product of this analysis to playback in an acoustically rich manner, forming musical collaborations with human players. We conclude by proposing guidelines for pedagogy and an educational environment for learning music, math, acoustics, and programming through interaction with Haile.

[1]  Eric Singer,et al.  LEMUR GuitarBot: MIDI Robotic String Instrument , 2003, NIME.

[2]  Andranick Tanguiane.  Artificial Perception and Music Recognition , 1993, Lecture Notes in Computer Science.

[3]  Sergi Jordà.  Afasia: The Ultimate Homeric One-Man-Multimedia-Band , 2002, NIME.

[4]  I. Shmulevich,et al.  A system for machine recognition of music patterns , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[5]  Anssi Klapuri,et al.  Measuring the similarity of Rhythmic Patterns , 2002, ISMIR.

[6]  Peter Desain,et al.  Rhythmic stability as explanation of category size , 2002 .

[7]  Tamara M. Lackner,et al.  The Musical Fireflies - Learning About Mathematical Patterns in Music Through Expression and Play , 2000 .

[8]  Eric Singer,et al.  LEMUR's Musical Robots , 2004, NIME.

[9]  Gil Weinberg,et al.  Interconnected Musical Networks: Toward a Theoretical Framework , 2005, Computer Music Journal.

[10]  Atsuo Takanishi,et al.  Development of an anthropomorphic flutist robot WF-3RII , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[11]  Peter Desain,et al.  A (De)Composable Theory of Rhythm Perception , 1992 .