An integrated model for predicting backchannel feedbacks

We present in this paper a method for generating in real time a great variability of multimodal backchannel feedbacks, increasing the naturalness of IVAs. The originality of the approach lies in its capacity to generate all types of features into a unique loop.

[1]  Elisabetta Bevacqua,et al.  Multimodal Backchannels for Embodied Conversational Agents , 2010, IVA.

[2]  Philippe Blache.  Dialogue management in task-oriented dialogue systems , 2017, ISIAA@ICMI.

[3]  Gaëlle Ferré,et al.  Unimodal and Bimodal Backchannels in Conversational English , 2017 .

[4]  J. Bavelas,et al.  Listeners as co-narrators. , 2000, Journal of personality and social psychology.

[5]  R. Espesser,et al.  Co-narration in French conversation storytelling: A quantitative insight , 2017 .

[6]  Stefan Kopp,et al.  An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing , 2013, Journal on Multimodal User Interfaces.

[7]  Deng Cai,et al.  Dialogue Act Recognition via CRF-Attentive Structured Network , 2017, SIGIR.

[8]  Dirk Heylen,et al.  Backchannel Strategies for Artificial Listeners , 2010, IVA.

[9]  Magalie Ochs,et al.  Mining a multimodal corpus of doctor’s training for virtual patient’s feedbacks , 2017, ICMI.

[10]  Julia Hirschberg,et al.  Turn-taking cues in task-oriented dialogue , 2011, Comput. Speech Lang..

[11]  Jackson Tolins,et al.  Addressee backchannels steer narrative development , 2014 .

[12]  Gabriel Skantze,et al.  Data-driven models for timing feedback responses in a Map Task dialogue system , 2014, Comput. Speech Lang..

[13]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.

[14]  Philippe Blache,et al.  Training doctors’ social skills to break bad news: evaluation of the impact of virtual environment displays on the sense of presence , 2019, Journal on Multimodal User Interfaces.

[15]  Nigel G. Ward,et al.  Prosodic features which cue back-channel responses in English and Japanese , 2000 .

[16]  Philippe Blache,et al.  Evaluating Temporal Predictive Features for Virtual Patients Feedbacks , 2019, IVA.