Emerging challenges in cognitive ergonomics: Managing swarms of self-organizing agent-based automation

As technology becomes more sophisticated, the problems of appropriate function allocation, mode errors, and misuse of automation will continue to challenge system safety and efficiency. Addressing these problems will require the field of cognitive ergonomics to consider three important challenges. First, to understand the human implications of self-organizing, multi-agent automation may involve recognizing the unique monitoring and control requirements. While current research has studied how people control a small number (2-10) of agents, the future will likely introduce the challenge of supervising hundreds of agents. Multi-agent automation that consists of hundreds of loosely connected intelligent agents may exhibit powerful new adaptive behaviours that may be difficult for people to understand and manage. Secondly, to understand human interaction with increasing complex automation may require more comprehensive analysis and modelling techniques. Current analysis techniques such as analysis of variance, tend to rely upon static representations of the human-system interaction when dynamic representations are needed. Thirdly, understanding human interaction with this increasingly complex automation may benefit from reconsidering new constructs to explain behaviour. The constructs of the information processing approach may not be sufficient to explain reliance on multi-agent automation. Addressing the challenge of this new technology will require a theoretical understanding of human behaviour that goes beyond a task-based description of welldefined scenarios. Cognitive ergonomics must develop an understanding of the basic cognitive demands associated with managing multi-agent automation, tools that consider the dynamics of the interaction, and constructs that address the dynamic decision making that governs reliance.

[1]  Robert E. Shaw,et al.  Ecological mechanics: A physical geometry for intentional constraints , 1988 .

[2]  Richard J. Hanowski,et al.  Driver Acceptance of Unreliable Traffic Information in Familiar and Unfamiliar Settings , 1997, Hum. Factors.

[3]  Nadine B. Sarter,et al.  Pilot Interaction With Cockpit Automation: Operational Experiences With the Flight Management System , 1992 .

[4]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[5]  Mitchel Resnick,et al.  Turtles, termites, and traffic jams - explorations in massively parallel microworlds , 1994 .

[6]  E. Bonabeau,et al.  Self-organization in social insects. , 1997, Trends in ecology & evolution.

[7]  R. Beer Dynamical approaches to cognitive science , 2000, Trends in Cognitive Sciences.

[8]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[9]  William H. Ross,et al.  MULTIPLE MEANINGS OF TRUST IN NEGOTIATION THEORY AND RESEARCH: A LITERATURE REVIEW AND INTEGRATIVE MODEL , 1996 .

[10]  John S. Bay,et al.  Distributed control of simulated autonomous mobile robot collectives in payload transportation , 1995, Auton. Robots.

[11]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Ichiro Suzuki,et al.  Distributed motion coordination of multiple mobile robots , 1990, Proceedings. 5th IEEE International Symposium on Intelligent Control 1990.

[13]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[14]  H. Damasio,et al.  Dissociation Of Working Memory from Decision Making within the Human Prefrontal Cortex , 1998, The Journal of Neuroscience.

[15]  Emily S. Patterson,et al.  A Simulation Study of Computer-Supported Inferential Analysis Under Data Overload , 1999 .

[16]  G. W. Johnson,et al.  Lunar base construction , 1963 .

[17]  A. Damasio,et al.  Deciding Advantageously Before Knowing the Advantageous Strategy , 1997, Science.

[18]  Marshall B. Romney,et al.  Calibration of auditors' probabilistic judgments: Some empirical evidence , 1982 .

[19]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[20]  Nadine B. Sarter,et al.  Team Play with a Powerful and Independent Agent: Operational Experiences and Automation Surprises on the Airbus A-320 , 1997, Hum. Factors.

[21]  Thomas B. Sheridan,et al.  Considerations in Modeling the Human Supervisory Controller , 1975 .

[22]  Rena A. Conejo The Effects of Highlighting, Validity, and Feature Type on Air-to-Ground Target Acquisition Performance. , 1998 .

[23]  Thomas D. Seeley,et al.  Honey Bee Colonies are Group‐Level Adaptive Units , 1997, The American Naturalist.

[24]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[25]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[26]  William Rogers,et al.  Pilot Opinions on Cockpit Automation issues , 1998 .

[27]  Peter A. Hancock,et al.  The Future of Function Allocation , 1996 .

[28]  Nadine B. Sarter,et al.  Team Play with a Powerful and Independent Agent: A Full-Mission Simulation Study , 2000, Hum. Factors.

[29]  A. Damasio,et al.  Individuals with sociopathic behavior caused by frontal damage fail to respond autonomically to social stimuli , 1990, Behavioural Brain Research.

[30]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[31]  Nadine B. Sarter,et al.  Pilot Interaction With Cockpit Automation II: An Experimental Study of Pilots’ Model and Awareness of the Flight Management System , 1994 .

[32]  D. Jolly,et al.  Trust between man and machine in a teleoperation system , 1996 .

[33]  Jing Wang,et al.  Swarm Intelligence in Cellular Robotic Systems , 1993 .

[34]  Nadine B. Sarter,et al.  How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control , 1995, Hum. Factors.

[35]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[36]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[37]  Nigel R. Franks,et al.  Complex trails and simple algorithms in ant foraging , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[38]  Fumihito Arai,et al.  Evaluation on flexibility of swarm intelligent system , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[39]  Robert F. Port,et al.  MIND IN MOTION: , 2019, Dune.

[40]  Michael Shafto,et al.  MODES IN AUTOMATED COCKPITS: PROBLEMS, DATA ANALYSIS, AND A MODELING FRAMEWORK , 1996 .

[41]  Wei Min Tao,et al.  A decentralized approach for cooperative sweeping by multiple mobile robots , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[42]  George Wright,et al.  Coherence, Calibration, and Expertise in Judgmental Probability Forecasting , 1994 .

[43]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[44]  Rodney A. Brooks,et al.  Lunar base construction robots , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[45]  J. G. Holmes,et al.  Trust in close relationships. , 1985 .

[46]  A. Damasio The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[47]  Giulio Sandini,et al.  Robots and Biological Systems: Towards a New Bionics? , 2012, NATO ASI Series.

[48]  John D. Lee,et al.  Augmenting the operator function model with cognitive operations: assessing the cognitive demands of technological innovation in ship navigation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[49]  Emilie M. Roth,et al.  Can We Ever Escape from Data Overload? A Cognitive Systems Diagnosis , 1999, Cognition, Technology & Work.

[50]  E. Thelen,et al.  The dynamics of embodiment: A field theory of infant perseverative reaching , 2001, Behavioral and Brain Sciences.