Trends & Controversies: Mixed-initiative interaction

James F. Allen, University of Rochester Mixed-initiative interaction is a key aspect of effective human-computer interaction and has great potential to affect work on multiagent systems. The term mixed-initiative interactionis sometimes conflated with human-computer interaction itself, but this is a mistake because almost all models of HCI so far are not mixedinitiative, and mixed-initiative systems need not involve a human. It is perhaps in HCI where we will see the greatest impact. The development of mixed-initiative intelligent systems will ultimately revolutionize the world of computing even more than the recent move to GUIs, in my view. This essay describes the goals of research in mixed-initiative interaction, suggests a general framework for thinking about work in the area based on the properties of human dialogue, and then briefly describes the key problems to overcome before mixed-initiative systems become a reality. For simplicity, I will focus on a single scenario consisting of two agents: a human and an intelligent system. Mixed-initiative interaction can occur in many other scenarios as well, including between multiple machines cooperating to perform tasks (such as in distributed planning) or between multiple people and machines interacting to coordinate their activities (collaboration systems, for example). Most everything I say here generalizes to these other cases. In fact, many of the issues become even more crucial as the number of agents grows. In many examples, I will draw from our experience in building mixed-initiative planning systems over the last five years. 1–3.

[1]  Eric K. Ringger,et al.  A Robust System for Natural Spoken Dialogue , 1996, ACL.

[2]  Marilyn A. Walker,et al.  Evaluating spoken dialogue agents with PARADISE: Two case studies , 1998, Comput. Speech Lang..

[3]  Eric Horvitz,et al.  A computational architecture for conversation , 1999 .

[4]  Rebecca J. Passonneau,et al.  Discourse Segmentation by Human and Automated Means , 1997, CL.

[5]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[6]  Barbara Di Eugenio,et al.  The COCONUT project: Dialogue Annotation Manual , 1998 .

[7]  Chung Hee Hwang,et al.  The TRAINS project: a case study in building a conversational planning agent , 1994, J. Exp. Theor. Artif. Intell..

[8]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[9]  Eric Horvitz,et al.  Attention-Sensitive Alerting , 1999, UAI.

[10]  Gwyneth Doherty-Sneddon,et al.  The Reliability of a Dialogue Structure Coding Scheme , 1997, CL.

[11]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[12]  James F. Allen,et al.  TRAINS-95: Towards a Mixed-Initiative Planning Assistant , 1996, AIPS.

[13]  Marilyn A. Walker,et al.  The Effect of Resource Limits and Task Complexity on Collaborative Planning in Dialogue , 1995, Artif. Intell..

[14]  Eric Horvitz,et al.  Uncertainty, Utility, and Misunderstanding: A Decision-Theoretic Perspective on Grounding in Conversational Systems , 1999 .

[15]  Johanna D. Moore,et al.  An Empirical Investigation of Proposals in Collaborative Dialogues , 1998, ACL.

[16]  Robert D. Rodman,et al.  The effects of restricted vocabulary size on voice interactive discourse structure , 1988 .

[17]  Morena Danieli,et al.  Metrics for Evaluating Dialogue Strategies in a Spoken Language System , 1996, ArXiv.

[18]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[19]  Marilyn A. Walker,et al.  Mixed Initiative in Dialogue: An Investigation into Discourse Segmentation , 1990, ACL.

[20]  D. Richard Hipp,et al.  Spoken Natural Language Dialog Systems: A Practical Approach , 1994 .

[21]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[22]  Henry Lieberman,et al.  Compelling intelligent user interfaces—how much AI? , 1997, IUI '97.

[23]  Jean Carletta,et al.  Planning to Fail, Not Failing to Plan: Risk-Taking and Recovery in Task-Oriented Dialogue , 1992, COLING.

[24]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[25]  Hector J. Levesque,et al.  Preliminaries to a collaborative model of dialogue , 1994, Speech Communication.

[26]  Lenhart K. Schubert,et al.  Planning in Complex Worlds via Mixed-Initiative Interaction , 1997 .