Shifting role for human factors in an ‘unmanned’ era

ABSTRACT Human factors practitioners (HFPs) play many different roles in the design, creation, operation and maintenance of engineered systems. Less well known are the methods which are aimed at helping with the early stages of design, which are more systems-oriented and often involve questions of the concept of operation in which the engineered system will be fielded. Emerging from the field of cognitive engineering, these methods, including simulation, cognitive work analysis, cognitive task analyses and hierarchical task analysis, will be important as autonomous systems become increasingly capable. Even the most capable systems will continue to interact with humans, and it is at these interfaces between humans and engineered systems that HFP will continue to be needed. This paper describes recent work to leverage these methods to inform concepts of operation in aviation and space, machine learning algorithms and goal-oriented human–machine collaboration.

[1]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[2]  Karen M. Feigh,et al.  Modeling Work for Cognitive Work Support System Design in Operational Control Centers , 2007 .

[3]  Richard C Wilde,et al.  One hundred US EVAs: a perspective on spacewalks. , 2002, Acta astronautica.

[4]  Karen M. Feigh,et al.  Predicting Task Intent From Surface Electromyography Using Layered Hidden Markov Models , 2017, IEEE Robotics and Automation Letters.

[5]  Jennifer Wilson,et al.  Flight Deck Automation issues , 1999 .

[6]  W. Turk,et al.  Writing requirements for engineers [good requirement writing] , 2006 .

[7]  Laura D. Strater,et al.  Assessing Automation for Aviation Personnel using a Predictive Model of SA , 2009 .

[8]  Ellen J. Bass,et al.  Using Formal Verification to Evaluate Human-Automation Interaction: A Review , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Karen M. Feigh,et al.  Decision Support System Requirements Definition for Human Extravehicular Activity Based on Cognitive Work Analysis , 2016, Journal of cognitive engineering and decision making.

[10]  Paul M. Salmon,et al.  Cognitive work analysis and design: current practice and future practitioner requirements , 2015 .

[11]  Elliot E. Entin,et al.  Measures for Evaluation of Team Processes and Performance in Experiments and Exercises , 2022 .

[12]  Amy R. Pritchett,et al.  'Party line' information use studies and implications for ATC datalink communications , 1995, Proceedings of 14th Digital Avionics Systems Conference.

[13]  Kikuo Asai,et al.  Human Computer Interaction: New Developments , 2008 .

[14]  Brian F. Gore,et al.  Survey and assessment of crew performance evaluation methods applicable to human spacecraft design , 2015, 2015 IEEE Aerospace Conference.

[15]  R.W. Butler,et al.  A formal methods approach to the analysis of mode confusion , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[16]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[17]  Stephan Merz,et al.  Model Checking , 2000 .

[18]  Andrea Lockerd Thomaz,et al.  Object-Focused Advice in Reinforcement Learning , 2016, AAMAS.

[19]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[20]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[21]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[22]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[23]  Andrea Lockerd Thomaz,et al.  Policy Shaping: Integrating Human Feedback with Reinforcement Learning , 2013, NIPS.

[24]  Sidney Dekker,et al.  Anticipating the effects of technological change: A new era of dynamics for human factors , 2000 .

[25]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[26]  Karen M. Feigh,et al.  Information flow model of human extravehicular activity operations , 2015, 2015 IEEE Aerospace Conference.

[27]  H. M. Shih,et al.  The history of human factors and ergonomics , 2000 .

[28]  Scott A. Shappell,et al.  A Human Error Analysis of Commercial Aviation Accidents Using the Human Factors Analysis and Classification System (HFACS) , 2001 .

[29]  Rashaad E. T. Jones,et al.  Assessing Automation for Aviation Personnel Using a Predictive Model of Situation Awareness , 2009 .

[30]  Eduardo Salas,et al.  Assessment of Coordination Demand for Aircrew Coordination Training , 1993 .

[31]  Luke B. Johnson,et al.  Adaptive mission planning for coupled human-robot teams , 2016, 2016 American Control Conference (ACC).

[32]  Arya Irani,et al.  Utilizing negative policy information to accelerate reinforcement learning , 2015 .

[33]  William C. Elm,et al.  Case Studies: Applied Cognitive Work Analysis in the Design of Innovative Decision Support , 2003 .

[34]  Catherine M. Burns,et al.  Ecological Interface Design in Aviation Domains: Work Domain Analysis of Automated Collision Detection and Avoidance , 2003 .

[35]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[36]  David D. Walden,et al.  Systems engineering handbook : a guide for system life cycle processes and activities , 2015 .

[37]  Neville A. Stanton,et al.  Ecological Interface Design Two Decades On: Whatever Happened to the SRK Taxonomy? , 2015, IEEE Transactions on Human-Machine Systems.

[38]  Michael D. Byrne.  Human performance modeling. , 2015 .

[39]  Ken Funk,et al.  Cockpit Task Management: Preliminary Definitions, Normative Theory, Error Taxonomy, and Design Recommendations , 1991 .

[40]  Byung-In Kim,et al.  Realization of a short cycle time in warehouse replenishment and order picking , 2003 .

[41]  Karen M. Feigh,et al.  Generic Agent Models for Simulations of Concepts of Operation: Part 2 , 2014, J. Aerosp. Inf. Syst..

[42]  Karen M. Feigh,et al.  Requirements for Effective Function Allocation , 2014 .

[43]  Karen M. Feigh,et al.  Example of a Complementary Use of Model Checking and Agent-Based Simulation , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[44]  Kim M Cardosi.  An Analysis of En Route Controller-Pilot Voice Communications , 1993 .

[45]  Michael C. Dorneich,et al.  Towards a Characterization of Adaptive Systems: a Framework for Researchers and System Designers , 2017 .

[46]  Karen M. Feigh,et al.  Work Models that Compute to Describe Multiagent Concepts of Operation: Part 1 , 2014, J. Aerosp. Inf. Syst..

[47]  Randall W. Gibb,et al.  Classification of Air Force Aviation Accidents: Mishap Trends and Prevention , 2008 .

[48]  Ann M. Bisantz,et al.  Ecological Displays, Information Integration, and Display Format , 2014 .

[49]  Becky L. Hooey,et al.  Human performance modeling in aviation , 2007 .

[50]  Jeannette M. Wing.  A specifier's introduction to formal methods , 1990, Computer.

[51]  Karen M. Feigh,et al.  Option and constraint generation using Work Domain Analysis , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[52]  Cliff Fitzgerald,et al.  Developing baxter , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[53]  Richard W. Pew,et al.  Human-system integration in the system development process : a new look , 2007 .

[54]  Karen M. Feigh,et al.  Measuring Human-Automation Function Allocation , 2014 .

[55]  Joan Cahill,et al.  Envisioning Improved Work Practices and Associated Technology Requirements in the Context of the Broader Socio-technical System , 2008 .

[56]  K. Vivaldini.  AUTOMATIC ROUTING OF FORKLIFT ROBOTS IN WAREHOUSE APPLICATIONS , 2009 .

[57]  Martin Buss,et al.  Human-Robot Collaboration: a Survey , 2008, Int. J. Humanoid Robotics.

[58]  Sidney Dekker,et al.  Envisioned practice, enhanced performance: The riddle of future (ATM) systems , 2002 .

[59]  L J Skitka,et al.  Automation bias: decision making and performance in high-tech cockpits. , 1997, The International journal of aviation psychology.

[60]  Karen M. Feigh,et al.  Learning to Predict Intent from Gaze During Robotic Hand-Eye Coordination , 2017, AAAI.

[61]  Karen M. Feigh,et al.  Application of Abstraction Hierarchies to Incorporate Human Knowledge for Machine Learning , 2015 .

[62]  Karen M. Feigh,et al.  Example of a Complementary Use of Model Checking and Human Performance Simulation , 2014, IEEE Transactions on Human-Machine Systems.

[63]  Kim J. Vicente,et al.  Coping with Human Errors through System Design: Implications for Ecological Interface Design , 1989, Int. J. Man Mach. Stud..

[64]  Karen M. Feigh,et al.  Learning From Explanations Using Sentiment and Advice in RL , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[65]  Raunak P. Bhattacharyya.  Analysis and synthesis of allocations of authority and responsibility in novel air traffic concepts of operation , 2016 .

[66]  Judith Orasanu,et al.  Decision Making in Action , 1994 .

[67]  Karen M. Feigh,et al.  Modeling Human–Automation Function Allocation , 2014 .

[68]  Alex Mihailidis,et al.  Twenty Years of Cognitive Work Analysis in Health Care , 2014 .

[69]  Daniel G. Morrow,et al.  Improving Pilot/Air Traffic Control Voice Communication in General Aviation , 2002 .