A Multitasking General Executive for Compound Continuous Tasks

As cognitive architectures move to account for increasingly complex real-world tasks, one of the most pressing challenges involves understanding and modeling human multitasking. Although a number of existing models now perform multitasking in real-world scenarios, these models typically employ customized executives that schedule tasks for the particular domain but do not generalize easily to other domains. This article outlines a general executive for the Adaptive Control of Thought-Rational (ACT-R) cognitive architecture that, given independent models of individual tasks, schedules and interleaves the models' behavior into integrated multitasking behavior. To demonstrate the power of the proposed approach, the article describes an application to the domain of driving, showing how the general executive can interleave component subtasks of the driving task (namely, control and monitoring) and interleave driving with in-vehicle secondary tasks (radio tuning and phone dialing).

[1]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[2]  Frank E. Ritter,et al.  Supporting cognitive models as users , 2000, TCHI.

[3]  Wayne D. Gray,et al.  Forgetting to Remember: The Functional Relationship of Decay and Interference , 2002, Psychological science.

[4]  Michael D. Byrne,et al.  Using Computational Cognitive Modeling to Diagnose Possible Sources of Aviation Error , 2005 .

[5]  Matthew P. Reed,et al.  Comparison of driving performance on-road and in a low-cost simulator using a concurrent telephone dialling task , 1999 .

[6]  John E. Laird,et al.  Modeling dual-task performance improvement: Casting executive process knowledge acquisition as strategy refinement , 1998 .

[7]  Randolph M. Jones,et al.  Automated Intelligent Pilots for Combat Flight Simulation , 1998, AI Mag..

[8]  Erwin R. Boer,et al.  Toward an Integrated Model of Driver Behavior in Cognitive Architecture , 2001 .

[9]  J. Miller A queue-series model for reaction time, with discrete-stage and continuous-flow models as special cases. , 1993, Psychological review.

[10]  Richard L. Lewis,et al.  A constraint satisfaction approach to predicting skilled interactive performance , 2004, CHI 2004.

[11]  Frank J. Lee,et al.  Toward an ACT-R General Executive for Human Multitasking , 2004, ICCM.

[12]  Jannes Aasman,et al.  Modelling driver behaviour in soar , 1995 .

[13]  D. Kieras,et al.  Modern computational perspectives on executive mental processes and cognitive control: Where to from here? , 2000 .

[14]  M. Just,et al.  Computational modeling of high‐level cognition and brain function , 1999, Human brain mapping.

[15]  Michael Freed,et al.  Managing Multiple Tasks in Complex, Dynamic Environments , 1998, AAAI/IAAI.

[16]  John R. Anderson,et al.  Learning Real-time Over-the-shoulder Instructions in a Dynamic Task , 2004, ICCM.

[17]  Dario D. Salvucci An integrated model of eye movements and visual encoding , 2001, Cognitive Systems Research.

[18]  Niels Taatgen,et al.  Modeling Parallelization and Flexibility Improvements in Skill Acquisition: From Dual Tasks to Complex Dynamic Skills , 2005, Cogn. Sci..

[19]  Wolfgang Schoppek,et al.  Examples, rules, and strategies in the control of dynamic systems. , 2002 .

[20]  Dario D. Salvucci Predicting the effects of in-car interface use on driver performance: an integrated model approach , 2001, Int. J. Hum. Comput. Stud..

[21]  A. Modjtahedzadeh,et al.  A control theoretic model of driver steering behavior , 1990, IEEE Control Systems Magazine.

[22]  J. Jonides,et al.  Storage and executive processes in the frontal lobes. , 1999, Science.

[23]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[24]  Bryan Reimer,et al.  Glance analysis of driver eye movements to evaluate distraction , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[25]  Stephanie M. Doane,et al.  ADAPT: A Predictive Cognitive Model of User Visual Attention and Action Planning , 2000, User Modeling and User-Adapted Interaction.

[26]  Dario D. Salvucci Modeling Driver Distraction from Cognitive Tasks , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[27]  E. Koechlin,et al.  Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Bradley J. Best,et al.  Spatial Plans , Communication , and Teamwork in Synthetic MOUT Agents , 2003 .

[29]  Bonnie E. John,et al.  Cognitive Architecture and Modeling Idiom: An Examination of Three Models of the Wickens's Task , 1998 .

[30]  Frank J. Lee,et al.  Deciding when to switch tasks in time-critical multitasking , 2005, Cognitive Systems Research.

[31]  J C Fell,et al.  THE RELATIVE FREQUENCY OF UNSAFE DRIVING ACTS IN SERIOUS TRAFFIC CRASHES - SUMMARY TECHNICAL REPORT , 2000 .

[32]  Y Liu,et al.  Queueing network modeling of elementary mental processes. , 1996, Psychological review.

[33]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[34]  W W Wierwille,et al.  AUTOMOTIVE ERGONOMICS. CHAPTER 14. VISUAL AND MANUAL DEMANDS OF IN- CAR CONTROLS AND DISPLAYS , 1993 .

[35]  Kristen L. Macuga,et al.  Predicting the effects of cellular-phone dialing on driver performance , 2002, Cognitive Systems Research.

[36]  F. Ritter,et al.  Steps Towards Including Behavior Moderators in Human Performance Models in Synthetic Environments , 2000 .

[37]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[38]  Frank J. Lee,et al.  Production Compilation: A Simple Mechanism to Model Complex Skill Acquisition , 2003, Hum. Factors.

[39]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[40]  Constance S. Royden,et al.  From vision to action: experiments and models of steering control during driving. , 2000, Journal of experimental psychology. Human perception and performance.

[41]  Michael D. Byrne,et al.  Capture Of Visual Attention By Abrupt Onsets : A Model Of Contingent Orienting , 2003 .

[42]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[43]  Thomas A. Dingus,et al.  Attentional demand requirements of an automobile moving-map navigation system , 1989 .

[44]  Dietrich Dörner Proceedings of the Fifth International Conference on Cognitive Modeling , 2001 .

[45]  John R. Anderson,et al.  Serial modules in parallel: the psychological refractory period and perfect time-sharing. , 2001, Psychological review.

[46]  David E. Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. , 1997 .

[47]  John R. Anderson,et al.  Integrating analogical mapping and general problem solving: the path-mapping theory , 2001, Cogn. Sci..

[48]  John E. Laird,et al.  Creating Human-like Synthetic Characters with Multiple Skill Levels: A Case Study using the Soar Quakebot , 2001 .

[49]  J C Fell,et al.  THE RELATIVE FREQUENCY OF UNSAFE DRIVING ACTS IN SERIOUS TRAFFIC CRASHES - FINAL REPORT , 2001 .

[50]  J R Anderson,et al.  Task preparation and task repetition: two-component model of task switching. , 2001, Journal of experimental psychology. General.

[51]  Dario D. Salvucci,et al.  Choice and Learning under Uncertainty: A Case Study in Baseball Batting , 2003 .

[52]  Mark C. Detweiler,et al.  Predicting age-related differences in visual information processing using a two-stage queuing model. , 1996, The journals of gerontology. Series B, Psychological sciences and social sciences.

[53]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[54]  P.J. Antsaklis,et al.  Parameter learning for performance adaptation , 1990, IEEE Control Systems Magazine.

[55]  John R. Anderson,et al.  Time Perception: Beyond Simple Interval Estimation , 2004, ICCM.

[56]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[57]  Rob Gray,et al.  A Two-Point Visual Control Model of Steering , 2004, Perception.

[58]  Kevin A. Gluck,et al.  Comparing Three Variants of a Computational Process Model of Basic Aircraft Maneuvering , 2003 .

[59]  Bonnie E. John TYPIST: A Theory of Performance in Skilled Typing , 1996, Hum. Comput. Interact..

[60]  Dario D. Salvucci Modeling Driver Behavior in a Cognitive Architecture , 2006, Hum. Factors.

[61]  Randolph Nelson,et al.  Probability, Stochastic Processes, and Queueing Theory , 1995 .

[62]  John R Anderson,et al.  Neural mechanisms of planning: A computational analysis using event-related fMRI , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Rene J. de Pontbriand,et al.  Modeling Human Behavior with Integrated Cognitive Architectures: Comparison, Evaluation, and Validation Edited by Kevin A. Gluck & Richard A. Pew 2005, 440 pages, $55.00 Mahwah, NJ: Lawrence Erlbaum Associates ISBN 0-8058-5048-1 , 2007 .

[64]  John R. Anderson,et al.  Learning to achieve perfect timesharing: architectural implications of Hazeltine, Teague, and Ivry (2002). , 2005, Journal of experimental psychology. Human perception and performance.

[65]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[66]  Troy D. Kelley,et al.  Developing a Predictive Model of Dual Task Performance , 2003 .

[67]  G. Miller,et al.  Cognitive science. , 1981, Science.

[68]  Wayne D. Gray,et al.  THE NATURE AND TIMING OF INTERRUPTIONS IN A COMPLEX, COGNITIVE TASK: EMPIRICAL DATA AND COMPUTATIONAL COGNITIVE MODELS , 2003 .

[69]  C. Lebiere,et al.  An integrated theory of list memory. , 1998 .

[70]  Yili Liu,et al.  Modeling Steering Using the Queueing Network — Model Human Processor (QN-MHP) , 2003 .

[71]  Erik M. Altmann,et al.  The anatomy of serial attention: An integrated model of set shifting and maintenance , 2000 .

[72]  Randolph D. Nelson,et al.  Probability, stochastic processes, and queueing theory - the mathematics of computer performance modeling , 1995 .

[73]  David E. Kieras,et al.  Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task , 1997, TCHI.