Report from the NSF Future Directions Workshop, Toward User-Oriented Agents: Research Directions and Challenges

This USER Workshop was convened with the goal of defining future research directions for the burgeoning intelligent agent research community and to communicate them to the National Science Foundation. It took place in Pittsburgh Pennsylvania on October 24 and 25, 2019 and was sponsored by National Science Foundation Grant Number IIS-1934222. Any opinions, findings and conclusions or future directions expressed in this document are those of the authors and do not necessarily reflect the views of the National Science Foundation. The 27 participants presented their individual research interests and their personal research goals. In the breakout sessions that followed, the participants defined the main research areas within the domain of intelligent agents and they discussed the major future directions that the research in each area of this domain should take

[1]  Joel R. Tetreault,et al.  Finding Good Conversations Online: The Yahoo News Annotated Comments Corpus , 2017, LAW@ACL.

[2]  Brian Ecker,et al.  Internet Argument Corpus 2.0: An SQL schema for Dialogic Social Media and the Corpora to go with it , 2016, LREC.

[3]  Akira Shimazu,et al.  A System Architecture for Spoken Utterance Production in Collaborative Dialogue , 1997 .

[4]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[5]  Barbara Di Eugenio,et al.  KSC-PaL: A Peer Learning Agent that Encourages Students to take the Initiative , 2009, NAACL.

[6]  Matthew Henderson,et al.  The third Dialog State Tracking Challenge , 2014, 2014 IEEE Spoken Language Technology Workshop (SLT).

[7]  Albert A. Rizzo,et al.  Automatic audiovisual behavior descriptors for psychological disorder analysis , 2014, Image Vis. Comput..

[8]  Xiaoyu Shen,et al.  DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset , 2017, IJCNLP.

[9]  Ingrid Zukerman,et al.  Natural Language Processing and User Modeling: Synergies and Limitations , 2001, User Modeling and User-Adapted Interaction.

[10]  Joelle Pineau,et al.  A Survey of Available Corpora for Building Data-Driven Dialogue Systems , 2015, Dialogue Discourse.

[11]  Amanda Stent,et al.  Lexical and Syntactic Adaptation and Their Impact in Deployed Spoken Dialog Systems , 2009, NAACL.

[12]  Wojciech Zaremba,et al.  OpenAI Gym , 2016, ArXiv.

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Stefan Ultes,et al.  MultiWOZ - A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling , 2018, EMNLP.

[15]  Emily Mower Provost,et al.  Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition , 2014, ACM Multimedia.

[16]  Dorit Bar-On.  Communicative Intentions, Expressive Communication, and Origins of Meaning , 2017 .

[17]  Petros Maragos,et al.  Multimodal Processing and Interaction, Audio, Video, Text , 2010 .

[18]  Dilek Z. Hakkani-Tür,et al.  Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversations , 2019, INTERSPEECH.

[19]  Vasile Rus,et al.  A Comparison of Greedy and Optimal Assessment of Natural Language Student Input Using Word-to-Word Similarity Metrics , 2012, BEA@NAACL-HLT.

[20]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[21]  Dominic W. Massaro,et al.  A computer-animated tutor for spoken and written language learning , 2003, ICMI '03.

[22]  Nick Pawlowski,et al.  Rasa: Open Source Language Understanding and Dialogue Management , 2017, ArXiv.

[23]  Sharon L. Oviatt,et al.  The Paradigm Shift to Multimodality in Contemporary Computer Interfaces , 2015, Synthesis Lectures on Human-Centered Informatics.

[24]  Alexei A. Efros,et al.  Everybody Dance Now , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[26]  Oliver Lemon,et al.  A Simple and Generic Belief Tracking Mechanism for the Dialog State Tracking Challenge: On the believability of observed information , 2013, SIGDIAL Conference.

[27]  Eugene Agichtein,et al.  IrisBot : An Open-Domain Conversational Bot for Personalized Information Access , 2018 .

[28]  Jianfeng Gao,et al.  A Persona-Based Neural Conversation Model , 2016, ACL.

[29]  Desmond C. Ong,et al.  A Multimodal LSTM for Predicting Listener Empathic Responses Over Time , 2018, 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019).

[30]  Louis-Philippe Morency,et al.  Autonomous Virtual Human Agents for Healthcare Information Support and Clinical Interviewing , 2016 .

[31]  Louis-Philippe Morency,et al.  Multimodal Machine Learning: A Survey and Taxonomy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Kallirroi Georgila,et al.  SimSensei kiosk: a virtual human interviewer for healthcare decision support , 2014, AAMAS.

[33]  Jianfeng Gao,et al.  A Diversity-Promoting Objective Function for Neural Conversation Models , 2015, NAACL.

[34]  Jens Allwood,et al.  Feedback in Second Language Acquisition , 1992 .

[35]  Maxine Eskénazi,et al.  Prosodic Entrainment in an Information-Driven Dialog System , 2012, INTERSPEECH.

[36]  Maxine Eskénazi,et al.  Zero-Shot Dialog Generation with Cross-Domain Latent Actions , 2018, SIGDIAL Conference.

[37]  Jason Weston,et al.  Personalizing Dialogue Agents: I have a dog, do you have pets too? , 2018, ACL.

[38]  Mark J. F. Gales,et al.  Towards Using Conversations with Spoken Dialogue Systems in the Automated Assessment of Non-Native Speakers of English , 2016, SIGDIAL Conference.

[39]  Carlos Duarte,et al.  Adapting Multimodal Fission to User's Abilities , 2011, HCI.

[40]  James F. Allen,et al.  The TRAINS 93 Dialogues , 1995 .

[41]  Marilyn A. Walker,et al.  SlugBot: Developing a Computational Model andFramework of a Novel Dialogue Genre , 2019, ArXiv.

[42]  Jianfeng Gao,et al.  deltaBLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets , 2015, ACL.

[43]  Hans Peter Graf,et al.  Photo-Realistic Talking-Heads from Image Samples , 2000, IEEE Trans. Multim..

[44]  Gwyneth Doherty-Sneddon,et al.  The Reliability of a Dialogue Structure Coding Scheme , 1997, CL.

[45]  Pengcheng Luo,et al.  Synchronized gesture and speech production for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Mari Ostendorf,et al.  A Dynamic Speaker Model for Conversational Interactions , 2019, NAACL.

[47]  Ira Kemelmacher-Shlizerman,et al.  Synthesizing Obama , 2017, ACM Trans. Graph..

[48]  Roger K. Moore.  Is Spoken Language All-or-Nothing? Implications for Future Speech-Based Human-Machine Interaction , 2016, IWSDS.

[49]  Dilek Z. Hakkani-Tür,et al.  Zero-shot learning of intent embeddings for expansion by convolutional deep structured semantic models , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[51]  Pierre Lison,et al.  OpenDial: A Toolkit for Developing Spoken Dialogue Systems with Probabilistic Rules , 2016, ACL.

[52]  Maxine Eskénazi,et al.  Structured Fusion Networks for Dialog , 2019, SIGdial.

[53]  Wenhu Chen,et al.  Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention , 2019, ACL.

[54]  Hao Yan,et al.  More than just a pretty face: conversational protocols and the affordances of embodiment , 2001, Knowl. Based Syst..

[55]  Justine Cassell,et al.  Socially-Conditioned Task Reasoning for a Virtual Tutoring Agent , 2018, AAMAS.

[56]  Jianfeng Gao,et al.  A Neural Network Approach to Context-Sensitive Generation of Conversational Responses , 2015, NAACL.

[57]  Alfred Kobsa.  User Modeling and User-Adapted Interaction , 2005, User Modeling and User-Adapted Interaction.

[58]  Alexander I. Rudnicky,et al.  The RavenClaw dialog management framework: Architecture and systems , 2009, Comput. Speech Lang..

[59]  Johanna D. Moore,et al.  Exploiting user feedback to compensate for the unreliability of user models , 1992, User Modeling and User-Adapted Interaction.

[60]  Alan Ritter,et al.  Adversarial Learning for Neural Dialogue Generation , 2017, EMNLP.

[61]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[62]  Julio Abascal,et al.  Universal accessibility as a multimodal design issue , 2007, CACM.

[63]  José M. F. Moura,et al.  Visual Dialog , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Maxine Eskénazi,et al.  Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders , 2017, ACL.

[65]  Wolfgang Wahlster,et al.  Verbmobil: Foundations of Speech-to-Speech Translation , 2000, Artificial Intelligence.

[66]  Louis-Philippe Morency,et al.  It's only a computer: Virtual humans increase willingness to disclose , 2014, Comput. Hum. Behav..

[67]  Maxine Eskénazi,et al.  Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References , 2019, SIGdial.

[68]  David Vandyke,et al.  Multi-domain Neural Network Language Generation for Spoken Dialogue Systems , 2016, NAACL.

[69]  David R. Traum,et al.  Talking to Virtual Humans: Dialogue Models and Methodologies for Embodied Conversational Agents , 2006, ZiF Workshop.

[70]  David Pautler,et al.  Toward Scalable Dialog Technology for Conversational Language Learning: Case Study of the TOEFL® MOOC , 2018, INTERSPEECH.

[71]  Timnit Gebru,et al.  Datasheets for datasets , 2018, Commun. ACM.

[72]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[73]  Carlos Busso,et al.  Domain Adversarial for Acoustic Emotion Recognition , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[74]  Carolyn Penstein Rosé,et al.  Tutorial Dialogue as Adaptive Collaborative Learning Support , 2007, AIED.

[75]  Joelle Pineau,et al.  Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses , 2017, ACL.

[76]  Danqi Chen,et al.  CoQA: A Conversational Question Answering Challenge , 2018, TACL.

[77]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[78]  Henry A. Kautz,et al.  Real-time crowd labeling for deployable activity recognition , 2013, CSCW.

[79]  António J. R. Neves,et al.  Output Matters! Adaptable Multimodal Output for New Telerehabilitation Services for the Elderly , 2016, AAL.

[80]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[81]  Maxine Eskénazi,et al.  Let's go public! taking a spoken dialog system to the real world , 2005, INTERSPEECH.

[82]  Roger K. Moore.  A Bayesian explanation of the ‘Uncanny Valley’ effect and related psychological phenomena , 2012, Scientific Reports.

[83]  Matthew Henderson,et al.  A Repository of Conversational Datasets , 2019, Proceedings of the First Workshop on NLP for Conversational AI.

[84]  Eunsol Choi,et al.  QuAC: Question Answering in Context , 2018, EMNLP.

[85]  Anton Leuski,et al.  Virtual Patients for Clinical Therapist Skills Training , 2007, IVA.

[86]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[87]  Joakim Gustafson,et al.  Semi-supervised methods for exploring the acoustics of simple productive feedback , 2013, Speech Commun..

[88]  Cosmin Munteanu,et al.  MDWOZ: A Wizard of Oz Environment for Dialog Systems Development , 2000, LREC.

[89]  Arantxa Otegi,et al.  Survey on evaluation methods for dialogue systems , 2019, Artificial Intelligence Review.

[90]  Patrick Gebhard,et al.  Exploring a Model of Gaze for Grounding in Multimodal HRI , 2014, ICMI.

[91]  Maxine Eskénazi,et al.  Towards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learning , 2016, SIGDIAL Conference.

[92]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[93]  Maxine Eskénazi,et al.  CMU GetGoing: An Understandable and Memorable Dialog System for Seniors , 2019, ArXiv.

[94]  Gregory A. Sanders,et al.  DARPA communicator dialog travel planning systems: the june 2000 data collection , 2001, INTERSPEECH.

[95]  Deepak Agarwal,et al.  Personalized Recommendation of User Comments via Factor Models , 2011, EMNLP.

[96]  Jason Weston,et al.  Learning from Dialogue after Deployment: Feed Yourself, Chatbot! , 2019, ACL.

[97]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[98]  David Yarowsky,et al.  Exploring Demographic Language Variations to Improve Multilingual Sentiment Analysis in Social Media , 2013, EMNLP.

[99]  A. Ito,et al.  Why robots need body for mind communication - an attempt of eye-contact between human and robot , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[100]  Ana Paiva,et al.  Detecting user engagement with a robot companion using task and social interaction-based features , 2009, ICMI-MLMI '09.

[101]  Amy Ogan,et al.  Automated Pitch Convergence Improves Learning in a Social, Teachable Robot for Middle School Mathematics , 2018, AIED.

[102]  Pascale Fung,et al.  Zara The Supergirl: An Empathetic Personality Recognition System , 2016, NAACL.

[103]  Maxine Eskénazi,et al.  Beyond Turing: Intelligent Agents Centered on the User , 2019, ArXiv.

[104]  Pierre Dillenbourg,et al.  Grounding in Multi-modal Task-Oriented Collaboration , 1999 .

[105]  Geoffrey Zweig,et al.  Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learning , 2017, ACL.

[106]  Masayuki Okamoto,et al.  Wizard of Oz Method for Learning Dialog Agents , 2001, CIA.

[107]  Joelle Pineau,et al.  The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems , 2015, SIGDIAL Conference.

[108]  E. Razumovskaia.  Incorporating rules into end-to-end dialog systems , 2019 .

[109]  Lu Chen,et al.  A generalized rule based tracker for dialogue state tracking , 2014, 2014 IEEE Spoken Language Technology Workshop (SLT).

[110]  Xiao Yang,et al.  Leveraging User Engagement Signals For Entity Labeling in a Virtual Assistant , 2019, ArXiv.

[111]  Chin-Yew Lin,et al.  ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.

[112]  Masahiro Araki,et al.  Three-Party Interactive Tutoring System for Mastering Machine Learning , 2019 .

[113]  David R. Traum,et al.  Digital survivor of sexual assault , 2019, IUI.

[114]  Milica Gasic,et al.  Gaussian Processes for POMDP-Based Dialogue Manager Optimization , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[115]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[116]  Jianfeng Gao,et al.  Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access , 2016, ACL.

[117]  Sharon L. Oviatt,et al.  Spoken language in interpreted telephone dialogues , 1990, ICSLP.

[118]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[119]  Joelle Pineau,et al.  How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation , 2016, EMNLP.

[120]  Tiancheng Zhao,et al.  ReinForest : Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology , 2016 .

[121]  Stacy Marsella,et al.  Tears and fears: modeling emotions and emotional behaviors in synthetic agents , 2001, AGENTS '01.

[122]  Alan W. Black,et al.  Elderly perception of speech from a computer , 2002 .

[123]  Eduard Hovy,et al.  Generating Natural Language Under Pragmatic Constraints , 1988 .

[124]  David Suendermann-Oeft,et al.  Game-based Spoken Dialog Language Learning Applications for Young Students , 2018, INTERSPEECH.

[125]  Hua Ai,et al.  Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users , 2007, SIGDIAL.

[126]  Staffan Larsson,et al.  Information state and dialogue management in the TRINDI dialogue move engine toolkit , 2000, Natural Language Engineering.

[127]  José M. F. Moura,et al.  CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog , 2019, NAACL.

[128]  Sanja Fidler,et al.  Skip-Thought Vectors , 2015, NIPS.

[129]  Alon Lavie,et al.  Meteor Universal: Language Specific Translation Evaluation for Any Target Language , 2014, WMT@ACL.

[130]  Mitsuru Ishizuka,et al.  T2D: Generating Dialogues Between Virtual Agents Automatically from Text , 2007, IVA.

[131]  Alexander I. Rudnicky,et al.  The carnegie mellon communicator corpus , 2002, INTERSPEECH.

[132]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[133]  Mike Phillips.  APPLICATIONS OF SPOKEN LANGUAGE TECHNOLOGY AND SYSTEMS , 2006, 2006 IEEE Spoken Language Technology Workshop.

[134]  Carlos Busso,et al.  Interrelation Between Speech and Facial Gestures in Emotional Utterances: A Single Subject Study , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[135]  Carolyn Penstein Rosé,et al.  Triggering effective social support for online groups , 2014, TIIS.

[136]  Clare R. Voss,et al.  Cross-lingual Structure Transfer for Relation and Event Extraction , 2019, EMNLP.

[137]  John J. Godfrey,et al.  SWITCHBOARD: telephone speech corpus for research and development , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[138]  Matthew Henderson,et al.  The Second Dialog State Tracking Challenge , 2014, SIGDIAL Conference.

[139]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[140]  Carlos Busso,et al.  Facial Expression Recognition in the Presence of Speech Using Blind Lexical Compensation , 2016, IEEE Transactions on Affective Computing.

[141]  Gökhan Tür,et al.  Towards Zero-Shot Frame Semantic Parsing for Domain Scaling , 2017, INTERSPEECH.

[142]  Louis-Philippe Morency,et al.  Toward Objective, Multifaceted Characterization of Psychotic Disorders: Lexical, Structural, and Disfluency Markers of Spoken Language , 2018, ICMI.

[143]  Diane J. Litman,et al.  Evaluating a Spoken Dialogue System that Detects and Adapts to User Affective States , 2014, SIGDIAL Conference.

[144]  Kazuhiko Sumi,et al.  Speech-to-Gesture Generation: A Challenge in Deep Learning Approach with Bi-Directional LSTM , 2017, HAI.

[145]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[146]  Dilek Z. Hakkani-Tür,et al.  Interactive reinforcement learning for task-oriented dialogue management , 2016 .

[147]  Carlos Busso,et al.  Joint Analysis of the Emotional Fingerprint in the Face and Speech: A single subject study , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[148]  Matthias Scheutz,et al.  Pardon the Interruption: Managing Turn-Taking through Overlap Resolution in Embodied Artificial Agents , 2018, SIGDIAL Conference.

[149]  Maxine Eskénazi,et al.  Automated two-way entrainment to improve spoken dialog system performance , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[150]  Jörg Tiedemann,et al.  Parallel Data, Tools and Interfaces in OPUS , 2012, LREC.

[151]  Alessandro Moschitti,et al.  Twitter Sentiment Analysis with Deep Convolutional Neural Networks , 2015, SIGIR.

[152]  Silvia Coradeschi,et al.  A Short Review of Symbol Grounding in Robotic and Intelligent Systems , 2013, KI - Künstliche Intelligenz.

[153]  Saiganesh Swaminathan,et al.  Evorus: A Crowd-powered Conversational Assistant That Automates Itself Over Time , 2017, UIST.

[154]  Maxine Eskénazi,et al.  DialPort, Gone Live: An Update After A Year of Development , 2017, SIGDIAL Conference.

[155]  Jason Weston,et al.  ParlAI: A Dialog Research Software Platform , 2017, EMNLP.

[156]  Úlfar Erlingsson,et al.  The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks , 2018, USENIX Security Symposium.

[157]  Alexander I. Rudnicky,et al.  Expanding the Scope of the ATIS Task: The ATIS-3 Corpus , 1994, HLT.

[158]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[159]  Anton Nijholt,et al.  Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes , 2001, CHI.

[160]  T. Scott-Phillips.  Speaking Our Minds: Why human communication is different, and how language evolved to make it special , 2014 .

[161]  Joelle Pineau,et al.  The Second Conversational Intelligence Challenge (ConvAI2) , 2019, The NeurIPS '18 Competition.

[162]  Oliver Lemon,et al.  Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz Data: Bootstrapping and Evaluation , 2008, ACL.

[163]  Peng Xu,et al.  MoEL: Mixture of Empathetic Listeners , 2019, EMNLP.

[164]  Louis-Philippe Morency,et al.  Adolescent Suicidal Risk Assessment in Clinician-Patient Interaction , 2017, IEEE Transactions on Affective Computing.

[165]  Clare R. Voss,et al.  Object and Text-guided Semantics for CNN-based Activity Recognition , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[166]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.

[167]  Carlos Busso,et al.  Semi-Supervised Speech Emotion Recognition With Ladder Networks , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[168]  Ginevra Castellano,et al.  An exploration of user engagement in HCI , 2009, AFFINE '09.

[169]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.