Composition of musical sound to express robot's emotion with intensity and synchronized expression with robot's behavior

In human-robot interaction, emotion expression of robot is one of the important issue for interacting with human more dynamically. In this paper, we consider two issues in view of real robot implementation. One is emotional intensity expression and the other is synchronized expression with behavior of robot. To express emotional intensity, we regulate tempo, pitch, and volume of base emotion sound which are controllable parameters by computer system of robot. We also suggest musical structure which has repeatable section to synchronize with robot's behavior.

[1]  P. Juslin,et al.  Cue Utilization in Communication of Emotion in Music Performance: Relating Performance to Perception Studies of Music Performance , 2022 .

[2]  Dong-Soo Kwon,et al.  Emotional interaction model for a service robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[3]  The Continuum of words, voice and music. , 2005 .

[4]  Giovanni De Poli.  Methodologies for Expressiveness Modelling of and for Music Performance , 2004 .

[5]  Juan David Velásquez,et al.  Modeling Emotions and Other Motivations in Synthetic Agents , 1997, AAAI/IAAI.

[6]  K. Hevner,et al.  The affective value of pitch and tempo in music. , 1937 .

[7]  A. Gabrielsson,et al.  The influence of musical structure on emotional expression. , 2001 .

[8]  Takashi Kitagawa,et al.  Visualization of music impression in facial expression to represent emotion , 2006, APCCM.

[9]  Kyung-Won Lee,et al.  Composition of Musical Sound Expressing an Emotion of Robot Based on Musical Factors , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[10]  K. Hevner.  Expression in music: a discussion of experimental studies and theories. , 1935 .

[11]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[12]  K. Hevner.  Experimental studies of the elements of expression in music , 1936 .

[13]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[14]  Anders Friberg.  A fuzzy analyzer of emotional expression in music performance and body motion , 2005 .

[15]  Ruth Aylett,et al.  A New Approach to Emotion Generation and Expression , 2007 .