On Looking into the Black Box: Prospects and Limits in the Search for Mental Models

To place the arguments advanced in this paper in alternative points of view with regard to mental models are reviewed. Use of the construct in areas such as neural information processing, manual control, decision making, problem solving, and cognitive science are discussed. Also reviewed are several taxonomies of mental models. The available empirical evidence for answering questions concerning the nature and usage of mental models is then discussed. A variety of studies are reviewed where the type and form of humans' knowledge have been manipulated. Also considered are numerous transfer of training studies whose results provide indirect evidence of the nature of mental models. The alternative perspectives considered and the spectrum of empirical evidence are combined to suggest a framework within which research on mental models can be viewed. By considering interactions of dimensions of this framework, the most salient unanswered questions can be identified.

[1]  W. James Pragmatism, A New Name for Some Old Ways of Thinking: Together With Four Related Essays Selected From The Meaning of Truth , 2010 .

[2]  A. Whitehead Science and the Modern World , 1926 .

[3]  R. M. Elliott,et al.  Behavior of Organisms , 1991 .

[4]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[5]  Christopher Alexander Notes on the Synthesis of Form , 1964 .

[6]  R. D. Smallwood Internal Models and the Human Instrument Monitor , 1967 .

[7]  L. Elton,et al.  Public Knowledge—The Social Dimension of Science , 1968 .

[8]  William R. Ferrell,et al.  Human Operator Decision-Making in Manual Control , 1969 .

[9]  Thomas B. Sheridan,et al.  On How Often the Supervisor Should Sample , 1970, IEEE Trans. Syst. Sci. Cybern..

[10]  W. Ashby,et al.  Every Good Regulator of a System Must Be a Model of That System , 1970 .

[11]  David L. Kleinman,et al.  A control theoretic approach to manned-vehicle systems analysis , 1971 .

[12]  J. Greeno,et al.  Structural differences between outcomes produced by different instructional methods. , 1972 .

[13]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[14]  H. Simon,et al.  The mind's eye in chess. , 1973 .

[15]  W. Chase,et al.  Visual information processing. , 1974 .

[16]  W. T. Singleton,et al.  Man-machine systems , 1974 .

[17]  Stephen K. Reed,et al.  The role of analogy in transfer between similar problem states , 1974 .

[18]  Elwyn Edwards,et al.  The Human Operator in Process Control , 1974 .

[19]  Richard A. Swanson,et al.  The Effect of Alternative Training Methods on the Trouble-Shooting Performances of Maintenance Technicians. , 1975 .

[20]  Lambros Laios,et al.  Operator Performance in the Control of a Laboratory Process Plant , 1975 .

[21]  Richard E. Mayer,et al.  Acquisition of understanding and skill in relation to subjects' preparation and meaningfulness of instruction. , 1975 .

[22]  The effects of deviate internal representations in the optimal model of the human operator , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[23]  Donald A. Norman,et al.  Comments on learning: Schemata and memory representation , 1976 .

[24]  Thomas B. Sheridan,et al.  Monitoring Behavior and Supervisory Control , 1976 .

[25]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[26]  K. D. Duncan,et al.  Diagnosis of Plant Failures from a Control Panel: A Comparison of Three Training Methods , 1977 .

[27]  Henk G. Stassen,et al.  The Internal Model Concept: An Application to Modeling Human Control of Large Ships , 1977 .

[28]  Robert J. Sternberg,et al.  Component Processes in Analogical Reasoning. , 1977 .

[29]  John P Foley,et al.  Performance Measurement of Maintenance. , 1977 .

[30]  R. Weisberg,et al.  Transferring old associations to new situations: A nonautomatic process , 1978 .

[31]  William James,et al.  Pragmatism : a new name for some old ways of thinking ; The meaning of truth : a sequel to Pragmatism , 2010 .

[32]  Richard J. Jagacinski,et al.  Describing the Human Operator's Internal Model of a Dynamic System , 1978 .

[33]  G. Zukav,et al.  The dancing wu li masters : an overview of the new physics , 1979 .

[34]  Hubert L. Dreyfus,et al.  The Psychic Boom: Flying Beyond the Thought Barrier. , 1979 .

[35]  T. Govindaraj,et al.  Optimal Control Model Predictions of System Performance and Attention Allocation and Their Experimental Validation in a Display Design Study , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[36]  Van Heusden,et al.  Human prediction of third-order autoregressive time series. , 1980 .

[37]  J. B. Brooke,et al.  Interactive instruction in solving fault-finding problems—an experimental study , 1980 .

[38]  Van Bussel Human prediction of time series. , 1980 .

[39]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[40]  William B. Rouse,et al.  Human Detection and Diagnosis of System Failures , 1981 .

[41]  S. Baron,et al.  On the internal target model in a tracking task , 1981 .

[42]  Johan de Kleer,et al.  Towards a Theory of Qualitative Reasoning about Mechanisms and its Role in Troubleshooting , 1981 .

[43]  Arye R. Ephrath,et al.  Monitoring vs. Man-in-the-Loop Detection of Aircraft Control Failures , 1981 .

[44]  Andrea A. diSessa,et al.  Unlearning Aristotelian Physics: A Study of Knowledge-Based Learning , 1982, Cogn. Sci..

[45]  M. McCloskey Naive Theories of Motion. , 1982 .

[46]  Christopher D. Wickens,et al.  The Transfer of Failure-Detection Skills between Monitoring and Controlling Dynamic Systems , 1982 .

[47]  John C. Thomas,et al.  Metaphor and the Cognitive Representation of Computing Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[48]  William B. Rouse,et al.  A Mixed-Fidelity Approach to Technical Training , 1982 .

[49]  A. Jackson,et al.  The Air Traffic Controller's Picture as an Example of a Mental Model , 1982 .

[50]  D. Gentner,et al.  Flowing waters or teeming crowds: Mental models of electricity , 1982 .

[51]  John J. Clement,et al.  A conceptual model discussed by Galileo and used intuitively by physics students , 1983 .

[52]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[53]  J. Bransford,et al.  Constraints on access in a problem solving context , 1983, Memory & cognition.

[54]  Brian Surgenor,et al.  Validation for Performance Measurement in the Task of Fault Management , 1983 .

[55]  James A. Anderson,et al.  Cognitive and psychological computation with neural models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[56]  Barry G. Silverman,et al.  Analogy in systems management: A theoretical inquiry , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[57]  C. Linde,et al.  Linguistic methodology for the analysis of aviation accidents , 1983 .

[58]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[59]  P. Johnson-Laird Mental models , 1989 .

[60]  John R. Anderson The Architecture of Cognition , 1983 .

[61]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[62]  Benjamin Cohen,et al.  Models of Concepts , 1984, Cogn. Sci..

[63]  P. E. Lehner,et al.  Mental Models and Cooperative Problem Solving with Expert Systems , 1984 .

[64]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device. , 1984 .

[65]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[66]  R. Glaser Education and Thinking: The Role of Knowledge. , 1984 .

[67]  F. Reif,et al.  Effects of Knowledge Organization on Task Performance , 1984 .

[68]  B. Adelson When Novices Surpass Experts: The Difficulty of a Task May Increase With Expertise , 1984 .

[69]  Ken Eason,et al.  Analysis, design and evaluation of man-machine systems: Pergamon, Oxford, 1983, xvii + 424 pages, £60.00 , 1985 .

[70]  William B. Rouse,et al.  Review and Evaluation of Empirical Research in Troubleshooting , 1985 .

[71]  Sandra Scarr,et al.  Constructing psychology: Making facts and fables for our times. , 1985 .

[72]  William B. Rouse,et al.  Online assessment of the value of information for searchers of a bibliographic data base , 1985, Inf. Process. Manag..

[73]  William B. Rouse,et al.  The effects of type of knowledge upon human problem solving in a process control task , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[74]  Robert Glaser,et al.  Thoughts on Expertise , 1985 .

[75]  William B. Rouse,et al.  A rule-based model of human problem-solving behavior in dynamic environments , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[76]  R. Sternberg Human Abilities: An Information Processing Approach , 1985 .

[77]  D. Gentner,et al.  The Evolution of Mental Metaphors in Psychology. A 90-Year Retrospective , 1985 .

[78]  William B. Rouse,et al.  Human Problem Solving in Fault Diagnosis Tasks , 1986 .

[79]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[80]  N. Pennington Stimulus structures and mental representations in expert comprehension of computer programs , 1987, Cognitive Psychology.