Précis to a practical unified theory of cognition and action: Some lessons from EPIC computational models of human multiple-task performance

Abstract : Experimental psychology, cognitive science, and human factors engineering have progressed sufficiently far that a practical unified theory of cognition and action is now foreseeable. Such a theory soon may yield useful quantitative predictions about rapid human multiple task performance in applied settings. Toward this end, an Executive-Process/Interactive-Control (EPIC) architecture has been formulated with components whose assumed properties emulate fundamental perceptual, cognitive, and motor processes. On the basis of EPIC, a theorist may construct detailed computational models that characterize multiple task performance under both laboratory and real world conditions. For example, EPIC computational models provide good accounts of response latencies and accuracies from the psychological refractory period procedure, aircraft cockpit operation, and human computer interaction. As a result, major commonalities in performance across various task domains have been discovered, and efficacious principles for designing person machine interfaces have been identified. The substantive and methodological lessons learned from these advances constitute an instructive precis to further utilitarian theoretical unification.

[1]  F. Hecht “Surely you're joking, Mr. Feynman!” Adventures of a curious character , 1986 .

[2]  A. Newell Unified Theories of Cognition and the Role of Soar , 1992 .

[3]  K. A. Ericsson,et al.  Skill and Working Memory , 1982 .

[4]  Daniel Gopher,et al.  In Defence of Resources: On Structures, Energies, Pools and the Allocation of Attention , 1986 .

[5]  A. Allport,et al.  Selection for action: Some behavioral and neurophysiological considerations of attention and action , 1987 .

[6]  A. Welford THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[7]  Donald E. Broadbent,et al.  Decision and stress , 1971 .

[8]  R. Siegler The perils of averaging data over strategies: An example from children's addition. , 1987 .

[9]  W. Estes The problem of inference from curves based on group data. , 1956, Psychological bulletin.

[10]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[11]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[12]  D. Kahneman Attention and Effort , 1973 .

[13]  E. Spelke,et al.  Dividing Attention Without Alternation or Automaticity , 1980 .

[14]  W W Wierwille,et al.  Evaluation of 20 Workload Measures Using a Psychomotor Task in a Moving-Base Aircraft Simulator , 1983, Human factors.

[15]  L. Gugerty Situation Awareness During Driving: Explicit and Implicit Knowledge in Dynamic Spatial Memory , 1997 .

[16]  Roger W. Schvaneveldt,et al.  Effects of complexity in simultaneous reaction time tasks. , 1969 .

[17]  J. C. Johnston,et al.  Chronometric Evidence for Central Postponement in Temporally Overlapping Tasks , 2003 .

[18]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[19]  G. Logan Executive control of thought and action , 1985 .

[20]  Walter Reitman,et al.  14 – What Does It Take to Remember? , 1970 .

[21]  L. Karlin,et al.  Effects of Number of Alternatives on the Psychological Refractory Period , 1968, The Quarterly journal of experimental psychology.

[22]  J. Brožek Attention and Performance II. , 1971 .

[23]  John Theios,et al.  Reaction Time Measurements in the Study of Memory Processes: Theory and Data1 , 1973 .

[25]  S. Yantis,et al.  Abrupt visual onsets and selective attention: voluntary versus automatic allocation. , 1990, Journal of experimental psychology. Human perception and performance.

[26]  H. Pashler Dual-task interference and elementary mental mechanisms , 1993 .

[27]  J. Duncan Response Selection Errors in Spatial Choice Reaction Tasks , 1977 .

[28]  J. Deutsch Perception and Communication , 1958, Nature.

[29]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[30]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[31]  T. Salthouse Perceptual, cognitive, and motoric aspects of transcription typing. , 1986, Psychological bulletin.

[32]  Steven C. Shaffer,et al.  Microcomputer Human Operator Simulator (HOS-IV) , 1987 .

[33]  Donald E. Broadbent A word before leaving , 1993 .

[34]  J. C. Johnston,et al.  Locus of the single-channel bottleneck in dual-task interference , 1992 .

[35]  Leo Janos,et al.  Yeager, an autobiography , 1985 .

[36]  W. Hays Statistics for psychologists , 1963 .

[37]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[38]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[39]  仏教伝道協会 The teaching of Buddha , 1977 .

[40]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[41]  O. Neumann Beyond capacity: A functional view of attention , 1987 .

[42]  Allen Newell,et al.  Cumulating the science of HCI: from s-R compatibility to transcription typing , 1989, CHI '89.

[43]  Norman E. Lane,et al.  THE HUMAN OPERATOR SIMULATOR: AN OVERVIEW , 1981 .

[44]  Robert Koch Die psychologische Refraktärperiode , 1994 .

[45]  A. Greenwald,et al.  On doing two things at once. II. Elimination of the psychological refractory period effect. , 1973, Journal of experimental psychology.

[46]  Jennifer M. Glass,et al.  Concurrent response-selection processes in dual-task performance: Evidence for adaptive executive control of task scheduling. , 1999 .

[47]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[48]  William Shakespeare,et al.  The Tragedy of Hamlet, Prince of Denmark , 1985, Hamlet.

[49]  E. Hunt,et al.  Unified Model of Attention and Problem Solving. , 1986 .

[50]  S. Sternberg,et al.  The meaning of additive reaction-time effects: tests of three alternatives , 1993 .

[51]  D Gopher,et al.  Different difficulty manipulations interact differently with task emphasis: evidence for multiple resources. , 1982, Journal of experimental psychology. Human perception and performance.

[52]  John R. Anderson Language, Memory, and Thought , 1976 .

[53]  R. D. de Jong Multiple bottlenecks in overlapping task performance. , 1993, Journal of experimental psychology. Human perception and performance.

[54]  Donald A. Norman,et al.  Simulating a Skilled Typist: A Study of Skilled Cognitive-Motor Performance , 1982, Cogn. Sci..

[55]  Jennifer M. Glass,et al.  Adaptive executive control: Flexible multiple-task performance without pervasive immutable response-selection bottlenecks , 1995 .

[56]  A. T. Welford,et al.  Evidence of a Single-Channel Decision Mechanism Limiting Performance in a Serial Reaction Task* , 1959 .

[57]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[58]  P. Reuter-Lorenz,et al.  The reduction of saccadic latency by prior offset of the fixation point: An analysis of the gap effect , 1991, Perception & psychophysics.

[59]  David E. Meyer,et al.  Attention and performance XIV (silver jubilee volume): synergies in experimental psychology, artificial intelligence, and cognitive neuroscience , 1993 .

[60]  A. Osman,et al.  Dimensional overlap: cognitive basis for stimulus-response compatibility--a model and taxonomy. , 1990, Psychological review.

[61]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[62]  David E. Kieras,et al.  Towards a Practical GOMS Model Methodology for User Interface Design , 1988 .

[63]  G. Bower,et al.  Human Associative Memory , 1973 .

[64]  P. McLeod A Dual Task Response Modality Effect: Support for Multiprocessor Models of Attention , 1977 .

[65]  Allen Newell,et al.  Predicting the time to recall computer command abbreviations , 1986, CHI '87.

[66]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[67]  E. A. Alluisi,et al.  Some variables influencing the rate of gain of information. , 1962, Journal of experimental psychology.

[68]  John R. Anderson The Adaptive Character of Thought , 1990 .

[69]  Stephen Monsell,et al.  The Latency and Duration of Rapid Movement Sequences: Comparisons of Speech and Typewriting , 1978 .

[70]  D REYNOLDS,et al.  EFFECTS OF DOUBLE STIMULATION: TEMPORARY INHIBITION OF RESPONSE. , 1964, Psychological bulletin.

[71]  David E. Kieras,et al.  Predictive engineering models using the EPIC architecture for a high-performance task , 1995, CHI '95.

[72]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[73]  M. S. Mayzner,et al.  Human information processing : tutorials in performance and cognition , 1975 .

[74]  J. C. Johnston,et al.  The psychological refractory period effect following callosotomy: uncoupling of lateralized response codes. , 1998, Journal of experimental psychology. Human perception and performance.

[75]  R Gottsdanker,et al.  The persistence of psychological refractoriness. , 1971, Journal of motor behavior.

[76]  Allen Newell,et al.  Production Systems: Models of Control Structures , 1973 .

[77]  David E. Irwin,et al.  Modern mental chronometry , 1988, Biological Psychology.

[78]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[79]  Constance L. Heitmeyer,et al.  Direct Manipulation and Intermittent Automation in Advanced Cockpits , 1992 .

[80]  E. Callaway,et al.  Relationship between Reaction Time and Electroencephalographic Alpha Phase , 1960, Science.

[81]  T Shallice,et al.  Dual functions of consciousness. , 1972, Psychological review.

[82]  J. Jonides Towards a model of the mind's eye's movement. , 1980, Canadian journal of psychology.

[83]  J Jonides,et al.  Programming saccadic eye movements. , 1988, Journal of experimental psychology. Human perception and performance.

[84]  Richard B. Ivry,et al.  The PRP Effect Following Callosotomy: Residual Interference Despite Uncoupling of Lateralized Response Codes , 1995 .

[85]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[86]  Avishai Henik,et al.  Extrageniculate Contributions to Reflex Visual Orienting in Normal Humans: A Temporal Hemifield Advantage , 1991, Journal of Cognitive Neuroscience.

[87]  H. Pashler,et al.  Graded capacity-sharing in dual-task interference? , 1994, Journal of experimental psychology. Human perception and performance.

[88]  F. Donders On the speed of mental processes. , 1969, Acta psychologica.

[89]  A. Sanders Towards a model of stress and human performance. , 1983, Acta psychologica.

[90]  Steven W. Keele,et al.  Attention and human performance , 1973 .

[91]  J. Flavell Metacognitive aspects of problem solving , 1976 .

[92]  David E. Meyer,et al.  Demystification of cognitive insight: Opportunistic assimilation and the prepared-mind hypothesis , 1994 .

[93]  S. Luck,et al.  Electrocortical substrates of visual selective attention , 1993 .

[94]  C D Wickens,et al.  The effects of divided attention on information processing in manual tracking. , 1976, Journal of experimental psychology. Human perception and performance.

[95]  H. Frowein,et al.  Selective effects of barbiturate and amphetamine on information processing and response execution. , 1981, Acta psychologica.

[96]  R. Thouless Experimental Psychology , 1939, Nature.

[97]  A. Sanders 20 Stage Analysis of Reaction Processes , 1980 .

[98]  P. David Pearson Handbook of reading research. , 1990 .

[99]  P. Fitts,et al.  S-R compatibility: spatial characteristics of stimulus and response codes. , 1953, Journal of experimental psychology.

[100]  Donald Vreuls,et al.  Human-System Performance Measurement in Training Simulators , 1985 .

[101]  A. Treisman VERBAL CUES, LANGUAGE, AND MEANING IN SELECTIVE ATTENTION. , 1964, The American journal of psychology.

[102]  D. Bouwhuis,et al.  Attention and performance X : control of language processes , 1986 .

[103]  S. Yantis,et al.  Uniqueness of abrupt visual onset in capturing attention , 1988, Perception & psychophysics.

[104]  David E. Kieras,et al.  Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task , 1997, TCHI.

[105]  Paul M. Fitts,et al.  Perceptual-Motor Skill Learning1 , 1964 .

[106]  D. Broadbent,et al.  ON THE INTERACTION OF S-R COMPATIBILITY WITH OTHER VARIABLES AFFECTING REACTION TIME. , 1965, British journal of psychology.

[107]  Jeff Miller,et al.  Discrete and continuous models of human information processing: theoretical distinctions and empirical results. , 1988, Acta psychologica.

[108]  D. Kieras,et al.  EPIC Computational Models of Psychological Refractory-Period Effects in Human Multiple-Task Performance, , 1994 .

[109]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[110]  Gerald P. Chubb SAINT, A Digital Simulation Language for the Study of Manned Systems , 1981 .

[111]  David I. Mostofsky,et al.  Attention and Performance III , 1971 .

[112]  D. Norman,et al.  Attention to Action: Willed and Automatic Control of Behavior Technical Report No. 8006. , 1980 .

[113]  David E. Kieras,et al.  Toward a Model of Acquiring Procedures from Text , 1989 .

[114]  D. Rosenbaum Human movement initiation: specification of arm, direction, and extent. , 1980, Journal of experimental psychology. General.

[115]  David E. Kieras,et al.  The Acquisition and Performance of Text-Editing Skill: A Cognitive Complexity Analysis , 1990, Hum. Comput. Interact..

[116]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[117]  Mark C. Detweiler,et al.  The Role of Practice in Dual-Task Performance: Toward Workload Modeling a Connectionist/Control Architecture , 1988, Human factors.

[118]  David E. Kieras,et al.  PPS: A Parsimonious Production System, , 1987 .

[119]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[120]  Estes Wk The problem of inference from curves based on group data. , 1956 .

[121]  D. Allport,et al.  On the Division of Attention: A Disproof of the Single Channel Hypothesis , 1972, The Quarterly journal of experimental psychology.

[122]  A. Treisman Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[123]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[124]  R. Logie,et al.  Working memory and strategies in syllogistic-reasoning tasks , 1993, Memory & cognition.

[125]  Robert C. Williges,et al.  Behavioral Measures of Aircrew Mental Workload , 1979 .

[126]  Marcel Adam Just,et al.  The Role of Working Memory in Language Comprehension , 1988 .

[127]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[128]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[129]  Mark C. Detweiler,et al.  A Connectionist/Control Architecture for Working Memory , 1988 .

[130]  David E. Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. , 1997 .

[131]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[132]  David E. Kieras,et al.  Predicting Human Performance in Dual-Task Tracking and Decision Making with Computational Models using the EPIC Architecture , 1995 .

[133]  Борис Митрофанович Величковский,et al.  Рецензия на книгу "Attention and Performance IV" , 1976 .

[134]  J. Duncan Disorganisation of behaviour after frontal lobe damage , 1986 .

[135]  Daniel Gopher,et al.  Improving Time-Sharing Performance by Enhancing Voluntary Control on Processing Resources. , 1981 .

[136]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[137]  Allen Newell,et al.  Towards real-time GOMS: a model of expert behaviour in a highly interactive task , 1994, Behav. Inf. Technol..

[138]  D. Norman Memory and attention: An introduction to human information processing. , 1994 .

[139]  Robert Arthur North Task Components and Demands as Factors in Dual-Task Performance. , 1977 .

[140]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[141]  Daniel Gopher,et al.  Workload: An examination of the concept. , 1986 .

[142]  J. Kelso,et al.  Are movements prepared in parts? Not under compatible (naturalized) conditions. , 1980, Journal of experimental psychology. General.

[143]  M. C. Smith,et al.  Theories of the psychological refractory period. , 1967, Psychological bulletin.

[144]  N Moray,et al.  Where is capacity limited? A survey and a model. , 1967, Acta psychologica.

[145]  H. Pashler,et al.  Saccadic Eye Movements and Dual-Task Interference , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[146]  D. Meyer,et al.  Vowel similarity, connectionist models, and syllable structure in motor programming of speech , 1990 .

[147]  D H Krantz,et al.  Threshold theories of signal detection. , 1969, Psychological review.

[148]  D. Meyer,et al.  Speech production: Motor programming of phonetic features , 1985 .

[149]  Bonnie E. John Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information , 1990, CHI '90.

[150]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[151]  N. Moray Attention in Dichotic Listening: Affective Cues and the Influence of Instructions , 1959 .

[152]  D. Spalding The Principles of Psychology , 1873, Nature.

[153]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[154]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[155]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[156]  A. Treisman Contextual Cues in Selective Listening , 1960 .

[157]  A. Welford Single-channel operation in the brain. , 1967, Acta psychologica.

[158]  S. Rose Selective attention , 1992, Nature.

[159]  D. Damos Multiple-task performance , 2020 .

[160]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[161]  A F Sanders,et al.  Simulation as a tool in the measurement of human performance. , 1991, Ergonomics.

[162]  Allen Newell,et al.  A theory of stimulus-response compatibility applied to human-computer interaction , 1985, CHI '85.

[163]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[164]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[165]  Robert Gottsdanker Choice reaction time and the nature of the choice response , 1969 .

[166]  K. Lewin Field theory in social science , 1951 .

[167]  H. Pashler Do response modality effects support multiprocessor models of divided attention? , 1990, Journal of experimental psychology. Human perception and performance.

[168]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[169]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[170]  Joseph Wolpe Steven's handbook of experimental psychology (second edition): Edited by Richard C. Atkinson, Richard J. Herrnstein, Gardner Lindzey and R. Duncan Luce John Wiley & Sons, Inc., New York, 1988, 2,000 pp. , 1989 .

[171]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[172]  A B Kristofferson,et al.  Attention and psychophysical time. , 1967, Acta psychologica.