Experience, introspection and expertise: Learning to refine the case-based reasoning process

The case-based reasoning paradigm models how reuse of stored experiences contributes to expertise. In a case-based problem-solver, new problems are solved by retrieving stored information about previous problem-solving episodes and adapting it to suggest solutions to the new problems. The results are then themselves added to the reasoner's memory in new cases for future use. Despite this emphasis on learning from experience, however, experience generally plays a minimal role in models of how the case-based reasoning process is itself performed. Case-based reasoning systems generally do not refine the methods they use to retrieve or adapt prior cases, instead relying on static pre-defined procedures. The thesis of this article is that learning from experience can play a key role in building expertise by refining the case-based reasoning process itself. To support that view and to illustrate the practicality of learning to refine case-based reasoning, this article presents ongoing research into using intros...

[1]  Colin Camerer,et al.  The process-performance paradox in expert judgment - How can experts know so much and predict so badly? , 1991 .

[2]  Roger C. Schank,et al.  Inside case-based explanation , 1994, Artificial intelligence series.

[3]  Janet L. Kolodner,et al.  Improving Human Decision Making through Case-Based Decision Aiding , 1991, AI Mag..

[4]  L. R. Novick.  Analogical transfer, problem similarity, and expertise. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Eli Blevis,et al.  The Life Analysis & Depreciation Integrated Exemplar System (LADIES) , 1991 .

[6]  Kenneth M. Ford,et al.  Expertise in context: personally constructed, socially selected and reality-relevant? , 1997 .

[7]  Alun D. Preece,et al.  AAAI-93 Workshops: Summary Reports , 1994 .

[8]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[9]  Ekaterini P. Sycara.  Resolving adversarial conflicts: an approach integration case-based and analytic methods , 1987 .

[10]  J. Lancaster,et al.  Problem Solving in a Natural Task as a Function of Experience , 1987 .

[11]  David Leake,et al.  Using Introspective Reasoning to Guide Index Refinement in Case-Based Reasoning , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[12]  Michael Albert Redmond,et al.  Learning by observing and understanding expert problem-solving , 1992 .

[13]  Roger C. Schank,et al.  Creativity and Learning in a Case-Based Explainer , 1989, Artif. Intell..

[14]  David J. Mostow,et al.  Machine Transformation of Advice Into a Heuristic Search Procedure , 1983 .

[15]  David Leake,et al.  Planning to Learn , 1995 .

[16]  Phyllis Koton,et al.  Reasoning about Evidence in Causal Explanations , 1988, AAAI.

[17]  Christopher K. Riesbeck,et al.  TaxOps: a case-based advisor , 1991 .

[18]  John R. Anderson.  The Architecture of Cognition , 1983 .

[19]  David Leake,et al.  Learning Adaptation Strategies by Introspective Reasoning about Memory Search , 1993 .

[20]  Ashwin Ram,et al.  Goal-Driven Learning: Fundamental Issues: A Symposium Report , 1993, AI Mag..

[21]  Janet L. Kolodner,et al.  Toward a case-based aid for conceptual design , 1991 .

[22]  Kristian J. Hammond,et al.  Chapter 8 – Case-based Planning , 1989 .

[23]  David B. Leake,et al.  Using Introspective Reasoning to Refine Indexing , 1995, IJCAI.

[24]  K. Ericsson,et al.  Prospects and limits of the empirical study of expertise: an introduction , 1991 .

[25]  Ashwin Ram,et al.  Introspective reasoning using meta-explanations for multistrategy learning , 1995 .

[26]  R. Bareiss.  Exemplar-Based Knowledge Acquisition , 1989 .

[27]  Roger C. Schank,et al.  Explanation Patterns: Understanding Mechanically and Creatively , 1986 .

[28]  Kevin D. Ashley.  Modeling legal argument - reasoning with cases and hypotheticals , 1991, Artificial intelligence and legal reasoning.

[29]  K. VanLehn.  Problem solving and cognitive skill acquisition , 1989 .

[30]  Alberta Maria Segre,et al.  Machine Learning of Robot Assembly Plans , 1988 .

[31]  Alex Kass,et al.  Developing creative hypotheses by adapting explanations , 1991 .

[32]  P. Pirolli,et al.  The role of learning from examples in the acquisition of recursive programming skills. , 1985 .

[33]  Michael Freed,et al.  Model-Based Diagnosis of Planning Failures , 1990, AAAI.

[34]  U. Goswami.  Analogical Reasoning: What Develops? A Review of Research and Theory. , 1991 .

[35]  David Leake,et al.  Combining Rules and Cases to Learn Case Adaptation , 1995 .

[36]  David Leake,et al.  Adaptive Similarity Assessment for Case-Based Explanation , 1995 .

[37]  Dedre Gentner,et al.  Systematicity and Surface Similarity in the Development of Analogy , 1986, Cogn. Sci..

[38]  Kristian J. Hammond,et al.  Case-Based Planning: Viewing Planning as a Memory Task , 1989 .

[39]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1988, IJCAI 1989.

[40]  Karl Branting,et al.  Rules and Precedents as Complementary Warrants , 1991, AAAI.

[41]  Thomas R. Hinrichs,et al.  Problem solving in open worlds - a case study in design , 1992 .

[42]  Randall Davis,et al.  Model-based reasoning: troubleshooting , 1988 .

[43]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[44]  David Leake,et al.  Modeling Case-based Planning for Repairing Reasoning Failures , 1995 .

[45]  Kenneth D. Forbus,et al.  The Roles of Similarity in Transfer: Separating Retrievability From Inferential Soundness , 1993, Cognitive Psychology.

[46]  Mark H. Bickhard,et al.  Knowing Levels and Developmental Stages , 1986 .

[47]  J. Carbonell.  Learning by Analogy: Formulating and Generalizing Plans from Past Experience , 1983 .

[48]  Edwina L. Rissland,et al.  Heuristic Harvesting of Information for Case-Based Argument , 1994, AAAI.

[49]  Ashwin Ram,et al.  AQUA: Asking Questions and Understanding Answers , 1987, AAAI.

[50]  S. Read,et al.  This reminds me of the time when …: Expectation failures in reminding and explanation , 1991 .

[51]  David Leake.  Representing Self-knowledge for Introspection about Memory Search , 1995 .

[52]  J. Faries,et al.  The Effect of Similarity on Memory for Prior Problems , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[53]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[54]  Michael Freed,et al.  A model-based approach to the construction of adaptive case-based planning systems , 1991 .

[55]  Manuela M. Veloso,et al.  Planning and Learning by Analogical Reasoning , 1994, Lecture Notes in Computer Science.

[56]  Kevin D. Ashley,et al.  Compare and Contrast: A Test of Expertise , 1987, AAAI.

[57]  David C. Wilson,et al.  Learning to Improve Case Adaption by Introspective Reasoning and CBR , 1995, ICCBR.

[58]  Steve Fuller,et al.  The constitutively social character of expertise , 1994 .

[59]  Robert J. Sternberg,et al.  On being an expert: a cost-benefit analysis , 1992 .

[60]  David B. Leake,et al.  Learning to Refine Indexing by Introspective Reasoning , 1995, ICCBR.

[61]  Tom Michael Mitchell,et al.  Explanation-based generalization: A unifying view , 1986 .

[62]  Robert L. Campbell,et al.  The programmer's burden: developing expertise in programming , 1992 .

[63]  Christopher K. Riesbeck,et al.  Inside Case-Based Reasoning , 1989 .

[64]  Steven Minton,et al.  Selectively Generalizing Plans for Problem-Solving , 1985, IJCAI.

[65]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[66]  Jo-Anne LeFevre,et al.  Processing instructional texts and examples. , 1987 .

[67]  M. Scardamalia,et al.  Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise , 1993 .

[68]  David Leake,et al.  Constructive Similarity Assessment: Using Stored Cases to Define New Situations , 1992 .