Measuring mental models: Choosing the right tools for the job

With the evolving nature of high-technology workplaces, personnel are continually confronted with new, complex systems. Possession of accurate mental representations or “mental models” of these systems should enhance workers' understanding and use of the equipment. Incorporating mental model assessment, diagnosis, and instruction into training requires the selection of an appropriate measure of mental model knowledge. Because there is no agreed-upon measure of this knowledge, selection can be difficult. This study evaluated four mental model measures, with performance as the criterion. Three of the evaluated techniques were predictive of performance; two of these were independently predictive. Determining the relationship between a knowledge representation and performance can offer valuable information for designing and evaluating a training intervention.

[1]  M. Hanson Career/Life Planning Workshops As Career Services in Organizations--Are They Working?. , 1982 .

[2]  Richard E. Mayer,et al.  Instructional Manipulation of Users' Mental Models for Electronic Calculators , 1984, Int. J. Man Mach. Stud..

[3]  D. Broadbent,et al.  Implicit and explicit knowledge in the control of complex systems , 1986 .

[4]  Roger W. Schvaneveldt,et al.  Measuring the Structure of Expertise , 1985, Int. J. Man Mach. Stud..

[5]  T. Goldsmith,et al.  Assessing structural similarity of graphs , 1990 .

[6]  Thomas J. Shuell,et al.  Phases of Meaningful Learning , 1990 .

[7]  Robert P. Bostrom,et al.  Individual Differences and Conceptual Models in Training Novice Users , 1989, Hum. Comput. Interact..

[8]  Nancy J. Cooke,et al.  Varieties of knowledge elicitation techniques , 1994, Int. J. Hum. Comput. Stud..

[9]  P. Johnson-Laird Mental models , 1989 .

[10]  John R. Wilson,et al.  Mental Models: Theory and Application in Human Factors , 1989 .

[11]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device. , 1984 .

[12]  Joel D. Schendel Training for Troubleshooting. , 1994 .

[13]  Nancy Staggers,et al.  Mental Models: Concepts for Human-Computer Interaction Research , 1993, Int. J. Man Mach. Stud..

[14]  J. Rasmussen,et al.  Mental procedures in real-life tasks: a case study of electronic trouble shooting. , 1974, Ergonomics.

[15]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[16]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[17]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[18]  D. Gentner,et al.  Flowing waters or teeming crowds: Mental models of electricity , 1982 .

[19]  Jochen Prümper,et al.  The effects of an active development of the mental model in the training process: experimental results in a word processing system , 1988 .

[20]  Thomas P. Moran,et al.  Mental models and problem solving in using a calculator , 1983, CHI '83.

[21]  Nancy J. Cooke,et al.  Predicting judgment time from measures of psychological proximity. , 1992 .

[22]  Francis T. Durso,et al.  Recall and Measures of Memory Organization , 1986 .

[23]  A. Reber Implicit learning and tacit knowledge , 1993 .