Human-centered time-pressured decision making in dynamic complex systems

Many real-world applications are complex, dynamic, and uncertain. Human operators play an important role in ensuring the safety and in achieving operational effectiveness in such systems. Humans work with computerized processes in monitoring the system state and are often involved in re-planning, troubleshooting, and supervisory control tasks. During task performance, both humans and computerized processes bring in varying strengths and limitations. Research on human-centered automation in aviation, satellite ground control, and nuclear power plant control has resulted in broad guidelines on system design involving human and computerized processes in supervisory control. However, problems such as increased human error, lack of situational awareness, and opacity from poorly automated systems remain, particularly in scenarios where human operators must make decisions in time-pressured planning. While anecdotal evidence does exist that interactive systems are better than completely manual or completely automated systems, there is a lack of systematic studies of human-centered modeling in joint cognitive systems. This research addresses the issue of joint cognitive problem solving for a class of problems related to supervisory control of vehicle routing. The key research question addressed by this study is whether a human integrated approach helps in better generation of alternatives and better evaluation of alternatives that would potentially lead to better solutions to problems. This research aims to develop a systematic approach to couple humans and machines to include effective task partitioning. The hypotheses related to the research questions are empirically evaluated, using human subjects, in prototypical realistic scenarios. Empirical results from a simulated military mission indicate that the human integrated approach resulted in better overall performance when compared to purely automated solutions for vehicle routing problems considered in this research study. Specifically, significantly more high priority targets were covered in the human integrated approach compared to the automated solution without any significant degradation with respect to all the other dependent measures including percentage of total targets covered, low priority targets covered, total targets covered in threat zone, high priority targets covered in threat zone, and low priority targets covered in threat zone. Results also indicated that the graphical representation of the alternatives leads to quicker evaluation time than tabular representation. One of the primary contributions of this research is a framework to demonstrate the rationale of using joint cognitive systems in time-pressured decision making. Some of the other contributions include a methodology for the evaluation of alternatives in a cognitively effective manner, and a baseline to compare results of future studies in interactive modeling.

[1]  E. D. Brill,et al.  Modeling to Generate Alternatives: The HSJ Approach and an Illustration Using a Problem in Land Use Planning , 1982 .

[2]  L Levy,et al.  SCHEDULING THE POSTAL CARRIERS FOR THE UNITED STATES POSTAL SERVICE: AN APPLICATION OF ARC PARTITIONING AND ROUTING. VEHICLE ROUTING: METHODS AND STUDIES. STUDIES IN MANAGEMENT SCIENCE AND SYSTEMS - VOLUME 16 , 1988 .

[3]  Ralph L. Keeney,et al.  Using Values in Operations Research , 1994, Oper. Res..

[4]  Hsiao-Fan Wang,et al.  Group decision support with MOLP applications , 1989, IEEE Trans. Syst. Man Cybern..

[5]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[6]  Brian W. Baetz,et al.  Generating alternative solutions for dynamic programming-based planning problems , 1990 .

[7]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[8]  Anthony F. Norcio,et al.  Adaptive human-computer interfaces: a literature survey and perspective , 1989, IEEE Trans. Syst. Man Cybern..

[9]  Graham Clark,et al.  Service Operations Management , 2001 .

[10]  E. L. Kaufman,et al.  The discrimination of visual number. , 1949, The American journal of psychology.

[11]  John R. Reid The USAF Aerospace Expeditionary Force: Flying into the 21st Century. , 1999 .

[12]  Laura Ellen Moody Supporting vehicle routing problem-solving using visualization and interactive optimization , 1993 .

[13]  Frank De Troyer,et al.  Visualisation of climatic environments based on the 'Test Reference Year' , 2004 .

[14]  Peter A. Hancock,et al.  Human-Centered Design of Unmanned Aerial Vehicles , 2003 .

[15]  B. Malakooti,et al.  Multiple criteria approach and generation of efficient alternatives for machine-part family formation in group technology , 2002 .

[16]  Christian Wagner,et al.  The Architecture of an Information System for the Support of Alternative Generation , 1991, J. Manag. Inf. Syst..

[17]  L J Skitka,et al.  Automation bias: decision making and performance in high-tech cockpits. , 1997, The International journal of aviation psychology.

[18]  Wayne Zachary,et al.  A Cognitively-Based Functional Taxonomy of Decision Support Techniques , 1986, SGCH.

[19]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[20]  Journal of Geographic Information and Decision Analysis, vol.1, no.1, pp. 25-44, 1997 , 1997 .

[21]  Elliot E. Entin,et al.  Situation awareness and human performance in target recognition , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[22]  M Beaudouin-Lafon,et al.  An overview of human-computer interaction. , 1993, Biochimie.

[23]  Peter C. Bell,et al.  Visual Interactive Modelling in Operational Research: Successes and Opportunities , 1985 .

[24]  William B. Carlton,et al.  Dynamic Routing of Unmanned Aerial Vehicles Using Reactive Tabu Search , 2001 .

[25]  Eiichi Taniguchi,et al.  Vehicle Routing and Scheduling , 2001 .

[26]  Mina Akaishi,et al.  Time-tunnel: visual analysis tool for time-series numerical data and its aspects as multimedia presentation tool , 2004, Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004..

[27]  Gilbert Laporte,et al.  A Tabu Search Heuristic for the Static Multi-Vehicle Dial-a-Ride Problem , 2002 .

[28]  John P. Norback,et al.  A Clustering and Insertion Heuristic Applied to a Large Routeing Problem in Food Distribution , 1991 .

[29]  Alex Kirlik,et al.  Supervisory control in a dynamic and uncertain environment: a process model of skilled human-environment interaction , 1993, IEEE Trans. Syst. Man Cybern..

[30]  Gilbert Laporte,et al.  The vehicle routing problem: An overview of exact and approximate algorithms , 1992 .

[31]  A.,et al.  Cognitive Engineering , 2008, Encyclopedia of GIS.

[32]  J. F. Pierce,et al.  ON THE TRUCK DISPATCHING PROBLEM , 1971 .

[33]  John M. Flach,et al.  MGA: a decision support system for complex, incompletely defined problems , 1990, IEEE Trans. Syst. Man Cybern..

[34]  K. Mosier,et al.  Human Decision Makers and Automated Decision Aids: Made for Each Other? , 1996 .

[35]  T. Glenn Bailey,et al.  Reactive Tabu Search in unmanned aerial reconnaissance simulations , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[36]  Florian Jentsch,et al.  Automation and Crew Performance: The Importance of Who and What , 1996 .

[37]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[38]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[39]  Hirokazu Nishitani,et al.  Human-computer interaction in the new process technology , 1996 .

[40]  Hideki Yamamoto,et al.  Pressure measurement of air cushions for SCI patients , 2000, IEEE Trans. Instrum. Meas..

[41]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[42]  Joe Marks,et al.  Human-guided tabu search , 2002, AAAI/IAAI.

[43]  Christine M. Mitchell,et al.  Operations Automation: Definition, Examples, and a Human-Centered Approach , 1999 .

[44]  R I Thackray,et al.  Detection efficiency on an air traffic control monitoring task with and without computer aiding. , 1989, Aviation, space, and environmental medicine.

[45]  T. T. Narendran,et al.  An interactive procedure for multiobjective optimization using nash bargaining principle , 1990, Decis. Support Syst..

[46]  David Woods,et al.  Representation aiding: a ten year retrospective , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[47]  Barry Render,et al.  Service Operations Management , 1990 .

[48]  M. L. Fisher Interactive optimization , 1986 .

[49]  Heath A. Ruff,et al.  Human-Integrated Supervisory Control of Uninhabited Combat Aerial Vehicles , 2000, J. Robotics Mechatronics.

[50]  Alok Aggarwal,et al.  Cooperative Multiobjective Decision Support for the Paper Industry , 1999, Interfaces.

[51]  Paolo Toth,et al.  Models, relaxations and exact approaches for the capacitated vehicle routing problem , 2002, Discret. Appl. Math..

[52]  Kip Smith,et al.  Situation Awareness Is Adaptive, Externally Directed Consciousness , 1995, Hum. Factors.

[53]  Sundaram Narayanan,et al.  Decision support for supply chain analysis , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[54]  C. D. J. Waters Interactive Vehicle Routeing , 1984 .

[55]  H. Donald Ratliff,et al.  INTERACTIVE OPTIMIZATION METHODOLOGY FOR FLEET SCHEDULING , 1986 .

[56]  Chetan Patel,et al.  Integrating genetic algorithms and interactive simulations for airbase logistics planning , 2000 .

[57]  J. W. McDaniel Rules for fighter cockpit automation , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[58]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[59]  Gregory Gutin,et al.  The traveling salesman problem , 2006, Discret. Optim..

[60]  Eugene L. Lawler,et al.  Traveling Salesman Problem , 2016 .

[61]  Gerasimos Rigatos,et al.  A Pareto-optimal genetic algorithm for warehouse multi-objective optimization , 2001 .

[62]  Christine M. Mitchell,et al.  GT-MSOCC: A Domain for Research on Human - Computer Interaction and Decision Aiding in Supervisory Control Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[63]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[64]  Philip J. Smith,et al.  Brittleness in the design of cooperative problem-solving systems: the effects on user performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[65]  Stacey D. Scott,et al.  Investigating human-computer optimization , 2002, CHI.

[66]  Joel L. Ryan Embedding a Reactive Tabu Search Heuristic in Unmanned Aerial Vehicle Simulations. , 1998 .

[67]  Michael J. Barnes,et al.  Crew Simulations for Unmanned Aerial Vehicle (UAV) Applications: Sustained Effects, Shift Factors, Interface Issues, and Crew Size , 1998 .

[68]  John Piggott,et al.  Situational awareness and safety , 2001 .

[69]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[70]  Lawrence Bodin,et al.  THE STATE OF THE ART IN THE ROUTING AND SCHEDULING OF VEHICLES AND CREWS: EXECUTIVE SUMMARY , 1981 .

[71]  Christine M. Mitchell,et al.  Model-based communicative acts: human-computer collaboration in supervisory control , 1994, Int. J. Hum. Comput. Stud..

[72]  Raymond R. Hill,et al.  A Java™ universal vehicle router for routing unmanned aerial vehicles , 2004 .

[73]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[74]  Mary Fendley,et al.  A Knowledge-Based System To Model Human Supervisory Control In Dynamic Planning , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[75]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[76]  Abderrafiaa Koukam,et al.  An Integrated Model for Interactive Systems , 1996 .

[77]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[78]  R. Keeney Decision analysis: an overview. , 1982, Operations research.

[79]  Ralph L. Keeney,et al.  Feature Article - Decision Analysis: An Overview , 1982, Oper. Res..

[80]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[81]  Christine M. Mitchell,et al.  An architecture to support incremental automation of complex systems , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[82]  William B. Rouse,et al.  Engineering complex systems: implications for research in systems engineering , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[83]  Bijan Fazlollahi,et al.  A Method for Generation of Alternatives by Decision Support Systems , 2001, J. Manag. Inf. Syst..

[84]  Gerald W. Evans,et al.  Multicriteria optimization of simulation models , 1991, 1991 Winter Simulation Conference Proceedings..

[85]  Bruce L. Golden,et al.  VEHICLE ROUTING: METHODS AND STUDIES , 1988 .