The Acoustic Front-End in Scenarios of Interaction Research

The paper is concerning some problems which are posed by the growing interest in social interaction research as far as they can be solved by engineers in acoustics and speech technology. Firstly the importance of nonverbal and paraverbal modalities in two prototypical scenarios are discussed: face-to-face interactions in psychotherapeutic consulting and side-by-side interactions of children cooperating in a computer game. Some challenges in processing signals are stated with respect to both scenarios. The following technologies of acoustic signal processing are discussed: (a) analysis of the influence of the room impulse response to the recognition rate, (b) adaptive two-channel microphone, (c) localization and separation of sound sources in rooms, and (d) single-channel noise suppression.

[1]  Pierre Philippot,et al.  The Role of Nonverbal Behavior in Clinical Settings , 2003 .

[2]  Ailbhe Ní Chasaide,et al.  The role of voice quality in communicating emotion, mood and attitude , 2003, Speech Commun..

[3]  Diane Hirschfeld,et al.  Towards an evaluation standard for speech control concepts in real-world scenarios , 2003, INTERSPEECH.

[4]  Rüdiger Hoffmann,et al.  Analysis of Verbal and Nonverbal Acoustic Signals with the Dresden UASR System , 2007, COST 2102 Workshop.

[5]  Rüdiger Hoffmann,et al.  The harming part of room acoustics in automatic speech recognition , 2007, INTERSPEECH.

[6]  Michael S. Brandstein,et al.  Microphone Arrays - Signal Processing Techniques and Applications , 2001, Microphone Arrays.

[7]  Jens Blauert,et al.  Analysis and Synthesis of Auditory Scenes , 2005 .

[8]  H. Ellgring.  Nonverbal communication in depression , 1989 .

[9]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[10]  E Mergenthaler,et al.  The Relationship Among Attachment Representation, Emotion-Abstraction Patterns, and Narrative Style: A Computer-Based Text Analysis of the Adult Attachment Interview , 2000, Psychotherapy research : journal of the Society for Psychotherapy Research.

[11]  Rainer Krause.  Stuttering and Nonverbal Communication: Investigations about Affect Inhibition and Stuttering , 1980 .

[12]  Uwe Altmann,et al.  Analysis of Nonverbal Involvement in Dyadic Interactions , 2007, COST 2102 Workshop.

[13]  Wolfgang Herbordt.  Sound Capture for Human / Machine Interfaces: Practical Aspects of Microphone Array Signal Processing (Lecture Notes in Control and Information Sciences) , 2005 .

[14]  Olivier Cappé,et al.  Elimination of the musical noise phenomenon with the Ephraim and Malah noise suppressor , 1994, IEEE Trans. Speech Audio Process..

[15]  L CASSOTTA,et al.  AVTA: A DEVICE FOR AUTOMATIC VOCAL TRANSACTION ANALYSIS. , 1964, Journal of the experimental analysis of behavior.

[16]  Victor Zue,et al.  On organic interfaces , 2007, INTERSPEECH.

[17]  A. Bouhuys,et al.  Non-verbal interaction involvement as an indicator of prognosis in remitted depressed subjects , 2002, Psychiatry Research.

[18]  E Brähler.  [Recognition of the therapist's intervention style through automatic speech analysis]. , 1978, Zeitschrift fur Psychosomatische Medizin und Psychoanalyse.