论文信息 - Analysis environment of conversational structure with nonverbal multimodal data

Analysis environment of conversational structure with nonverbal multimodal data

This paper shows the IMADE (Interaction Measurement, Analysis, and Design Environment) project to build a recording and anlyzing environment of human conversational interactions. The IMADE room is designed to record audio/visual, human-motion, eye gazing data for building interaction corpus mainly focusing on understanding of human nonverbal behaviors. In this paper, we show the notion of interaction corpus and iCorpusStudio, software environment for browsing and analyzing the interaction corpus. We also present a preliminary experiment on multiparty conversations.

Toyoaki Nishida | Yasuyuki Sumi | Masaharu Yano

[1] Alexander H. Waibel,et al. Computers in the Human Interaction Loop , 2009, Handbook of Ambient Intelligence and Smart Environments.

[2] Mary P. Harper,et al. VACE Multimodal Meeting Corpus , 2005, MLMI.

[3] Tatsuya Kawahara,et al. Multi-modal recording, analysis and indexing of poster sessions , 2008, INTERSPEECH.

[4] Rainer Stiefelhagen,et al. Computers in the Human Interaction Loop , 2009, Human-Computer Interaction Series.

[5] Rainer Stiefelhagen,et al. Estimating the Lecturer's Head Pose in Seminar Scenarios - A Multi-view Approach , 2005, MLMI.

[6] Jean Carletta,et al. The AMI Meeting Corpus: A Pre-announcement , 2005, MLMI.