Memory recall in a process control system: a measure of expertise and display effectiveness

Previous research has shown that memory-recall performance is correlated with domain expertise. In this study, a process control system was selected as a vehicle for conducting research on memory recall. The primary purposes of the present work were to determine if the classic expertise effects originally obtained in chess generalize to this novel-domain and to evaluate the validity of memory recall as a measure of display effectiveness. Experts and novices viewed dynamic event sequences showing the behavior of a thermal-hydraulic system with two different displays, one that only contained information about thephysical components in the system (P) and another that also contained information about higher orderfunctional variables (P+F). There were three types of trials: normal, where the system was operating correctly; fault, where a single fault was introduced; and random, where the system’s behavior did not obey physical laws. On each trial, subjects were asked to recall the final state of the system and to diagnose the system state. The P+F display resulted in superior diagnosis performance compared with the P display. With regard to memory, there was some evidence of an interaction between trial type and expertise, with experts outperforming novices but primarily on meaningful trials. In addition, memory for the subset of variables most critical to diagnosis was better with the P+F display than with the P display, thereby indicating that memory recall can be a sensitive measure of display effectiveness. The results also clarify a theoretical problem that has existed for some:time in the literature, namely, the conditions under which expertise advantages are to be expected in memory-recall tasks. Collectively, these findings point to the potential benefits of adopting an applied context as a test bed for basic research issues.

[1]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  J. L. Myers.  Fundamentals of Experimental Design , 1972 .

[3]  Lauren Leslie,et al.  Effect of Prior Knowledge on Good and Poor Readers' Memory of Text. , 1988 .

[4]  Kim J. Vicente,et al.  Supporting knowledge-based behavior through ecological interface design , 1991 .

[5]  Michael T. Turvey,et al.  Skill Acquisition: An Event Approach with Special Reference to Searching for the Optimum of a Function of Several Variables , 1978 .

[6]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[7]  K. J. Vicente.  Adapting the memory recall paradigm to evaluate interfaces , 1988 .

[8]  Gavan Lintern,et al.  Perceptual Motor Skill: A Theoretical Framework , 1990 .

[9]  D E Egan,et al.  Chunking in recall of symbolic drawings , 1979, Memory & cognition.

[10]  P. Meehl.  Theory-Testing in Psychology and Physics: A Methodological Paradox , 1967, Philosophy of Science.

[11]  E. Gibson.  Principles of Perceptual Learning and Development , 1969 .

[12]  P. Meehl.  Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. , 1978 .

[13]  A. D. D. Groot.  Thought and Choice in Chess , 1978 .

[14]  H. Simon,et al.  Perception in chess , 1973 .

[15]  T. Pearson,et al.  Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  F. Allard,et al.  Skilled memory in expert figure skaters , 1991, Memory & cognition.

[17]  Dedre Gentner,et al.  Transfer of training as analogical mapping , 1988, IEEE Trans. Syst. Man Cybern..

[18]  Larry B. Wallnau,et al.  Statistics for the Behavioral Sciences , 1985 .

[19]  Bill Curtis,et al.  Modern Coding Practices and Programmer Performance , 1979, Computer.

[20]  V L Patel,et al.  Processing of critical information by physicians and medical students. , 1987, Journal of medical education.

[21]  K. J. Vicente,et al.  The Ecology of Human-Machine Systems II: Mediating 'Direct Perception' in Complex Work Domains , 1990 .

[22]  Thomas K. Landauer,et al.  Relations between cognitive psychology and computer system design , 1990 .

[23]  Reuven Dar,et al.  Another look at Meehl, Lakatos, and the scientific practices of psychologists. , 1987 .

[24]  J. Flach.  The Ecology of Human-Machine Systems I: Introduction , 1990 .

[25]  M. Myles-Worsley,et al.  The influence of expertise on X-ray image processing. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[26]  Neil Charness,et al.  Components of skill in bridge. , 1979 .

[27]  Ben Shneiderman,et al.  Measuring Computer Program Quality and Comprehension , 1977, Int. J. Man Mach. Stud..

[28]  William B. Rouse,et al.  On better mousetraps and basic research: Getting the applied world to the laboratory door , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  H. Simon,et al.  The mind's eye in chess. , 1973 .

[30]  K. R. Hammond,et al.  Generalizing over conditions by combining the multitrait-multimethod matrix and the representative design of experiments. , 1986, Psychological bulletin.

[31]  W. Schneider,et al.  Domain-Specific Knowledge and Memory Performance: A Comparison of High- and Low-Aptitude Children , 1989 .

[32]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device. , 1984 .

[33]  Ad Degroot,et al.  THE MEMORY RECALL PARADIGM - STRAIGHTENING OUT THE HISTORICAL RECORD , 1990 .