Wizard of Oz studies: why and how

We discuss current approaches to the development of natural-language dialo=we systems, and claim that they do not sufficiently consider the unique qualities of man-machine interaction as distinct from general human discourse. We conclude that empirical studies of this unique comnnmication situation is required for the development of user-friendly interactive systems. One way of achieving this is through the use of so-called Wizard of Oz studies. We describe our work in tlis area. The focus is on the practical execution of the studies and the methodological conclusions that we have drawn on the basis of our experience. While the focus is on natural language interfams, the methods used and the conclusions drawn from the results obtained m of relevance also to other kinds of intelligent interfaces.

[1]  Annie Gal,et al.  COOPERATIVE RESPONSES IN DEDUCTIVE DATABASES , 1988 .

[2]  Wayne S. Murray,et al.  Dialogue with machines , 1988, Cognition.

[3]  Arne Jönsson,et al.  A Dialogue Manager Using Initiative-Response Units and Distributed Control , 1991, EACL.

[4]  Hubert Lehmann,et al.  Evaluation and Assessment of a Domain-Independent Natural Language Query System , 1985, IEEE Database Eng. Bull..

[5]  Herbert H. Clark,et al.  Definite reference and mutual knowledge In Aravind K. Joshi, Bonnie L. Webber, and Ivan A. Sag, editors , 1981 .

[6]  Raymonde Guindon,et al.  Cognitive science and its applications for human-computer interaction , 1988 .

[7]  N. Dahlbäck,et al.  Representations of discourse : cognitive and computational aspects , 1991 .

[8]  Nigel Gilbert,et al.  Simulating speech systems , 1991 .

[9]  S. Chipman.  The Remembered Present: A Biological Theory of Consciousness , 1990, Journal of Cognitive Neuroscience.

[10]  Philip R. Cohen.  The Pragmatics of Referring and the Modality of Communication , 1984, Comput. Linguistics.

[11]  Arne Jönsson,et al.  Talking to a Computer Is Not like Talking to Your Best Friend , 1988, SCAI.

[12]  Rachel Reichman,et al.  Getting computers to talk like you and me , 1985 .

[13]  R. Lakoff.  The logic of politeness: or minding your p''s and q''s , 1973 .

[14]  Arne Jönsson,et al.  A Method for Development of Dialogue Managers for Natural Language Interfaces , 1993, AAAI.

[15]  William C. Ogden.  Using Natural Language Interfaces , 1988 .

[16]  Arne Jönsson,et al.  Empirical Studies Of Discourse Representations For Natural Language Interfaces , 1989, EACL.

[17]  Harry Ralph Tennant.  Evaluation of natural language processors , 1981 .

[18]  Barbara J. Grosz,et al.  The representation and use of focus in dialogue understanding. , 1977 .

[19]  R. Gelman,et al.  The development of communication skills: modifications in the speech of young children as a function of listener. , 1973, Monographs of the Society for Research in Child Development.