The use of explicit user models in text generation: tailoring to a user's level of expertise

A question answering program that provides access to a large amount of data will be most useful if it can tailor its answers to each individual user. In particular, a user's level of knowledge about the domain of discourse is an important factor in this tailoring if the answer provided is to be both informative and understandable to the user. In this research, we address the issue of how the user's domain knowledge, or the level of expertise, might affect an answer. By studying texts we found that the user's level of domain knowledge affected the kind of information provided and not just the amount of information, as was previously assumed. Depending on the user's assumed domain knowledge, a description of a complex physical object can be either parts-oriented or process-oriented. Thus the user's level of expertise in a domain can guide a system in choosing the appropriate facts from the knowledge base to include in an answer. We propose two distinct descriptive strategies that can be used to generate texts aimed at naive and expert users. Users are not necessarily truly expert or fully naive however, but can be anywhere along a knowledge spectrum whose extremes are naive and expert. In this work, we show how our generation system, TAILOR, can use information about a user's level of expertise to combine several discourse strategies in a single text, choosing the most appropriate at each point in the generation process, in order to generate texts for users anywhere along the knowledge spectrum. TAILOR's ability to combine discourse strategies based on a user model allows for the generation of a wider variety of texts and the most appropriate one for the user.

[1]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[2]  Jerry R. Hobbs Conversation as Planned Behavior , 1979, Cogn. Sci..

[3]  Richard C. Anderson,et al.  Schemata as Scaffolding for the Representation of Information in Connected Discourse , 1977 .

[4]  Kathleen F. McCoy The ROMPER System: Responding to Object-Related Misconceptions using Perspective , 1986, ACL.

[5]  David J. Israel,et al.  Recognizing Intended Meaning and Speakers' Plans , 1981, IJCAI.

[6]  Derek H. Sleeman Inferring (Mal) Rules from Pupil's Protocols , 1982, ECAI.

[7]  Michelene T. H. Chi,et al.  Expertise in Problem Solving. , 1981 .

[8]  Wolfgang Wahlster,et al.  User Modelling in Anaphora Generation: Ellipsis and Definite Description , 1982, ECAI.

[9]  Eduard H. Hovy,et al.  Integrating Text Planning and Production in Generation , 1985, IJCAI.

[10]  Graeme D. Ritchie,et al.  The computational complexity of sentence derivation in functional unification grammar , 1986, COLING.

[11]  Katharina Morik,et al.  User Modelling, Dialog Structure, and Dialog Strategy in HAM-ANS , 1985, EACL.

[12]  Kenneth Wasserman,et al.  Representing Complex Physical Objects in Memory , 1982 .

[13]  William C. Mann,et al.  Discourse Structures for Text Generation , 1984, ACL.

[14]  J. Lancaster,et al.  Problem Solving in a Natural Task as a Function of Experience , 1987 .

[15]  Ronald R. Schmeck,et al.  Individual differences in cognition , 1983 .

[16]  Michael Lebowitz,et al.  RESEARCHER: An Overview , 1983, AAAI.

[17]  Michael Lebowitz Researcher: An Experimental Intelligent Information System , 1985, IJCAI.

[18]  Sandra Carberry,et al.  Plan Recognition and Its Use in Understanding Dialog , 1989 .

[19]  Judith Orasanu,et al.  Reading Comprehension: From Research to Practice. , 1986 .

[20]  Alexander Quilici,et al.  Detecting and Responding to Plan-Oriented Misconceptions , 1989 .

[21]  Candace L. Sidner,et al.  Plan parsing for intended response recognition in discourse 1 , 1985, Comput. Intell..

[22]  Harry R. Tennant Experience with the Evaluation of Natural Language Question Answerers , 1979, IJCAI.

[23]  Erich Nessen SC-UM: User modeling in the SINIX consultant , 1989, Appl. Artif. Intell..

[24]  C. Raymond Perrault,et al.  Analyzing Intention in Utterances , 1986, Artif. Intell..

[25]  Kathleen McKeown,et al.  Tailoring Explanations for the User , 1985, IJCAI.

[26]  Robert Wilensky,et al.  Artificial Intelligence and Language Processing Talking to Unix in English: an Overview of Uc , 2022 .

[27]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[28]  C. Linde,et al.  Spatial Networks as a Site for the Study of Language and Thought. , 1975 .

[29]  Raj Reddy,et al.  Graceful Interaction in Man-Machine Communication , 1979, IJCAI.

[30]  Alfred Kobsa,et al.  User Models in Dialog Systems , 1989, Symbolic Computation.

[31]  E. Shortliffe,et al.  Explanatory Power for Medical Expert Systems: Studies in the Representation of Causal Relationships for Clinical Consultations , 1982, Methods of Information in Medicine.

[32]  Derek H. Sleeman,et al.  UMFE: A User Modelling Front-End Subsystem , 1985, Int. J. Man Mach. Stud..

[33]  Colliers Collier's Encyclopedia , 1984 .

[34]  Ryszard S. Michalski,et al.  Automated Construction of Classifications: Conceptual Clustering Versus Numerical Taxonomy , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Eric Mays,et al.  Failures in Natural Language Systems: Applications to Data Base Query Systems , 1980, AAAI.

[36]  Elaine Rich,et al.  User Modeling via Stereotypes , 1998, Cogn. Sci..

[37]  S. Jerrold Kaplan,et al.  Cooperative Responses from a Portable Natural Language Query System , 1982, Artif. Intell..

[38]  Sandra Carberry,et al.  Tracking User Goals in an Information-Seeking Environment , 1983, AAAI.

[39]  Reuven Cohen,et al.  Incorporating user models into ex-pert systems for educational diagnosis , 1989 .

[40]  Michael Lebowitz,et al.  Generalization From Natural Language Text , 1983, Cogn. Sci..

[41]  Martha E. Pollack,et al.  A Model of Plan Inference That Distinguishes Between the Beliefs of Actors and Observers , 1986, ACL.

[42]  Cécile Paris,et al.  Functional Unification Grammar Revisited , 1987, ACL.

[43]  R. Sternberg Advances in the psychology of human intelligence , 1982 .

[44]  Robert Rubinoff,et al.  Adapting MUMBLE: Experience with Natural Language Generation , 1986, HLT.

[45]  Allan Collins,et al.  Misconceptions in student's understanding , 1979 .

[46]  Peter van Beek,et al.  A Model For Generating Better Explanations , 1987, ACL.

[47]  Jerry R. Hobbs Why Is Discourse Coherent , 1978 .

[48]  Kenneth Wasserman Unifying representation and generalization: understanding hierarchically structured objects , 1985 .

[49]  Michael Brady,et al.  Cooperative Responses From a Portable Natural Language Database Query System , 1983 .

[50]  Gerald G. Duffy,et al.  Comprehension instruction: Perspectives and suggestions , 1984 .

[51]  J. L. Weiner,et al.  BLAH, A System Which Explains its Reasoning , 1980, Artif. Intell..

[52]  Joseph E. Grimes,et al.  The Thread of Discourse , 1984 .

[53]  Judson B. Cross,et al.  Physics ; a basic science , 1963 .

[54]  G. Shortley,et al.  Elements of Physics , 1971 .