Design of a cooperative problem-solving system for enroute flight planning: An empirical study of its use by airline dispatchers

In a previous report, an empirical study of 30 pilots using the Flight Planning Testbed was reported. An identical experiment using the Flight Planning Testbed (FPT), except that 27 airline dispatchers were studied, is described. Five general questions were addressed in this study: (1) under what circumstances do the introduction of computer-generated suggestions (flight plans) influence the planning behavior of dispatchers (either in a beneficial or adverse manner); (2) what is the nature of such influences (i.e., how are the person's cognitive processes changed); (3) how beneficial are the general design concepts underlying FPT (use of a graphical interface, embedding graphics in a spreadsheet, etc.); (4) how effective are the specific implementation decisions made in realizing these general design concepts; and (5) how effectively do dispatchers evaluate situations requiring replanning, and how effectively do they identify appropriate solutions to these situations.

[1]  Christine M. Mitchell,et al.  Use of Model-Based Qualitative Icons and Adaptive Windows in Workstations for Supervisory Control Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Janet L. Kolodner,et al.  Using Experience in Clinical Problem Solving: Introduction and Framework , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Nancy G. Hall Diagnosing problems with the user interface for a strategic planning fuzzy DSS , 1988, IEEE Trans. Syst. Man Cybern..

[4]  Etienne Wenger,et al.  Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge , 1987 .

[5]  J. Hoc,et al.  Cognitive psychology of planning , 1988 .

[6]  Robert Thierauf,et al.  User-oriented decision support systems: Accent on problem finding , 1988 .

[7]  Barbara Hayes-Roth,et al.  A Cognitive Model of Planning , 1979, Cogn. Sci..

[8]  Randall Davis,et al.  Model-based reasoning: troubleshooting , 1988 .

[9]  Ian Benson,et al.  Some social and economic consequences of groupware for flight crew , 1990, CSCW '90.

[10]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[11]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[12]  Philip J. Smith,et al.  A Catalog of Errors , 1992, Int. J. Man Mach. Stud..

[13]  William B. Rouse,et al.  Studies of planning behavior of aircraft pilots in normal, abnormal, and emergency situations , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  D. Isenberg Thinking and Managing: A Verbal Protocol Analysis of Managerial Problem Solving , 1986 .

[15]  D. Gentner Mental Models , 1983 .

[16]  Kevin B. Bennett,et al.  Human Interaction with an "Intelligent" Machine , 1987, Int. J. Man Mach. Stud..

[17]  Paul E. Lehner,et al.  Cognitive Factors in User/Expert-System Interaction , 1987 .

[18]  P J Smith,et al.  An empirical evaluation of the performance of antibody identification tasks , 1991, Transfusion.

[19]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[20]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[21]  John M. Carroll,et al.  Interface design issues for advice-giving expert systems , 1987, CACM.

[22]  Philip J. Smith,et al.  Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation , 1994 .

[23]  Philip J. Smith,et al.  Knowledge-Based Search Tactics , 1993, Inf. Process. Manag..

[24]  James L. Alty,et al.  Expert Systems: An Alternative Paradigm , 1984, Int. J. Man Mach. Stud..

[25]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[26]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[27]  Jonathan Grudin,et al.  CSCW: the convergence of two development contexts , 1991, CHI.

[28]  J. B. Black,et al.  Cognition, computing, and cooperation , 1990 .

[29]  Allan Collins,et al.  Misconceptions in student's understanding , 1979 .

[30]  R. Wilensky Planning and Understanding: A Computational Approach to Human Reasoning , 1983 .

[31]  John L. Bennett,et al.  Learning from user experience with groupware , 1990, CSCW '90.

[32]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[33]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[34]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[35]  David Chapman,et al.  What are plans for? , 1990, Robotics Auton. Syst..

[36]  Earl D. Sacerdoti,et al.  Planning in a Hierarchy of Abstraction Spaces , 1974, IJCAI.

[37]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[38]  M. McCloskey Naive Theories of Motion. , 1982 .

[39]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[40]  Mark Stefik,et al.  Planning with Constraints (MOLGEN: Part 1) , 1981, Artif. Intell..

[41]  Stephen J. Andriole,et al.  Handbook of Decision Support Systems , 1989 .

[42]  Philip N. Johnson-Laird,et al.  Thinking; Readings in Cognitive Science , 1977 .

[43]  John A. Sorensen Generation and Evaluation of Near-Optimum Vertical Flight Profiles , 1983, 1983 American Control Conference.