How Experts Solve a Novel Problem in Experimental Design

Research on expert-novice differences has mainly focused on how experts solve familiar problems. We know far less about the skills and knowledge used by experts when they are confronted with novel problems within their area of expertise. This article discusses a study in which verbal protocols were taken from subjects of various expertise designing an experiment in an area with which they were unfamiliar. The results showed that even when domain knowledge is lacking, experts solve a novel problem within their area of expertise by dividing the problem into a number of subproblems that are solved in a specified order. The lack of domain knowledge is compensated for by using abstract knowledge structures and domain-specific heuristic strategies. However, the quality of their solutions is considerably lower than the quality attained by experts who were familiar with the type of problem to be solved. The results suggest that when experts are confronted with novel problems as compared with familiar problems, their form of reasoning remains intact, but the content of their reasoning suffers due to lack of domain knowledge.

[1]  L. R. Novick.  Analogical transfer, problem similarity, and expertise. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Beth Adelson,et al.  Modeling Software Design Within a Problem-Space Architecture , 1989 .

[3]  R. Glaser.  Education and Thinking: The Role of Knowledge. , 1984 .

[4]  Herbert A. Simon,et al.  Problem Solving and Reasoning. , 1984 .

[5]  K. Holyoak,et al.  Surface and structural similarity in analogical transfer , 1987, Memory & cognition.

[6]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[7]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[8]  Fn Kerlinger,et al.  Foundations of behavioral research (2nd ed. , 1973 .

[9]  Geoffrey Keppel,et al.  Science and Behavior: An Introduction to Methods of Research. 2nd ed. , 1981 .

[10]  C. Coogler,et al.  Foundations of Behavioral Research 2nd ed , 1974 .

[11]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[12]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[13]  Ann L. Brown,et al.  Reciprocal Teaching of Comprehension-Fostering and Comprehension-Monitoring Activities , 1984 .

[14]  B. Adelson,et al.  The Role of Domain Expenence in Software Design , 1985, IEEE Transactions on Software Engineering.

[15]  W. Grove.  Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[16]  M. Scardamalia,et al.  The psychology of written composition , 1987 .

[17]  Alan H. Schoenfeld,et al.  Mathematical Problem Solving , 1985 .

[18]  Timothy A. Post,et al.  Problem-Solving Skill in the Social Sciences , 1983 .

[19]  John M. Neale,et al.  Science and behavior : an introduction to methods of research / John M. Neale , 1973 .

[20]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[21]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[22]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[23]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[24]  B. Adelson.  Problem solving and the development of abstract categories in programming languages , 1981, Memory & cognition.

[25]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[26]  K. VanLehn.  Problem solving and cognitive skill acquisition , 1989 .

[27]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[28]  Jaime G. Carbonell,et al.  FERMI: A Flexible Expert Reasoner with Multi-Domain Inferencing , 1988, Cogn. Sci..

[29]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[30]  K. Holyoak.  Symbolic connectionism: Toward third-generation theories of expertise. , 1991 .