Ghost in the Cave - An Interactive Collaborative Game Using Non-verbal Communication

The interactive game environment, Ghost in the Cave, presented in this short paper, is a work still in progress. The game involves participants in an activity using non-verbal emotional expressions. Two teams use expressive gestures in either voice or body movements to compete. Each team has an avatar controlled either by singing into a microphone or by moving in front of a video camera. Participants/players control their avatars by using acoustical or motion cues. The avatar is navigated in a 3D distributed virtual environment using the Octagon server and player system. The voice input is processed using a musical cue analysis module yielding performance variables such as tempo, sound level and articulation as well as an emotional prediction. Similarly, movements captured from a video camera are analyzed in terms of different movement cues. The target group is young teenagers and the main purpose to encourage creative expressions through new forms of collaboration.

[1]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[2]  Thomas P. Rohrer The science and psychology of music performance: creative strategies for teaching and learning , 2004 .

[3]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[4]  Giovanni De Poli,et al.  An Abstract Control Space for Communication of Sensory Expressive Intentions in Music Performance , 2003 .

[5]  Anders Friberg,et al.  Automatic Real-Time Extraction of Musical Expression , 2002, ICMC.

[6]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[7]  Tom Rodden,et al.  Exploding the interface: experiences of a CSCW network , 1993, INTERCHI.

[8]  Marie-Louise Rinman,et al.  Forms of Interaction in Mixed Reality Media Perfomances - a study of the artistic event DESERT RAIN , 2002 .

[9]  P. Juslin,et al.  Toward a computational model of expression in music performance: The GERM model , 2001 .

[10]  Antonio Camurri,et al.  Interactive Systems Design: A KANSEI based Approach , 2002, NIME.

[11]  R. Parncutt,et al.  The Science and Psychology of Music Performance Creative Strategies for Teaching and Learning , 2002 .

[12]  Antonio Camurri,et al.  Improving the man-machine interface through the analysis of expressiveness in human movement , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[13]  P. Juslin Communicating emotion in music performance: A review and a theoretical framework , 2001 .