5. The application of human modeling technology to the design, evaluation and operation of complex systems

This chapter reviews the ability of the emerging human performance modeling technologies to support the design and operation of complex systems. The ability of existing technologies to meet current application needs is analyzed, and the results are then used to assess the areas where additional research and development is most needed. Following a brief history of human performance modeling, a taxonomy of models and modeling techniques is established, as a framework for remaining discussion. The human performance modeling technology base is separately analyzed for its ability to support system design processing and to support system operation. The system design process analysis considers the various roles that human performance models may play during that process, ranging from generating design concepts to affording simulation-based range of roles, from training to performance support to automation. These analyses demonstrate that human modeling technology has reached a sufficient state of maturity and has become a proven contributor of the complex systems engineering process. Challenges for further high-payoff research are also presented in five categories: cognition, knowledge management, team and organizational structure and processes, predictive models of training, and human-centered systems engineering.

[1]  S. Boorman,et al.  Social Structure from Multiple Networks. I. Blockmodels of Roles and Positions , 1976, American Journal of Sociology.

[2]  David B. Wortman,et al.  Simulation using SAINT: A User-Oriented Instruction Manual. , 1978 .

[3]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[4]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[5]  J. Moraal,et al.  Manned systems design : methods, equipment, and applications , 1981 .

[6]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[7]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[8]  William B. Rouse,et al.  Human-Technology Interaction in Complex Systems , 1993 .

[9]  I. Nonaka,et al.  How Japanese Companies Create the Dynamics of Innovation , 1995 .

[10]  Francis F. Martin,et al.  Computer modeling and simulation , 1968 .

[11]  Janis A. Cannon-Bowers,et al.  An Advanced Embedded Training Systems (AETS) for Tactical Team Training , 1998, Intelligent Tutoring Systems.

[12]  Daniel T. Risser,et al.  Army Hardman: Its Origin, Evaluation, Implementation to Date , 1984 .

[13]  Victor Lesser,et al.  The Evolution of Blackboard Control Architectures , 1992 .

[14]  Norman E. Lane,et al.  THE HUMAN OPERATOR SIMULATOR: AN OVERVIEW , 1981 .

[15]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[16]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[17]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[18]  P. Killworth,et al.  The Problem of Informant Accuracy: The Validity of Retrospective Data , 1984 .

[19]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[20]  D. Meadows,et al.  The Limits to Growth , 1972 .

[21]  J. S. Brown,et al.  Discrete movements in the horizontal plane as a function of their length and direction. , 1949, Journal of experimental psychology.

[22]  Jean MacMillan,et al.  Designing Optimal Organizational Structures for Combat Information Centers in the Next Generation of Navy Ships , 1999 .

[23]  John R. Anderson.  Language, Memory, and Thought , 1976 .

[24]  R. Dodge,et al.  The angular velocity of eye movements , 1901 .

[25]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[26]  S. Boorman,et al.  Social Structure from Multiple Networks. II. Role Structures , 1976, American Journal of Sociology.

[27]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[28]  J. Forrester.  Principles of systems : text and workbook, chapters 1 through 10 , 1968 .

[29]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[30]  J. Jay Wolf,et al.  A MODEL FOR DIGITAL SIMULATION OF TWO-OPERATOR MAN-MACHINE SYSTEMS , 1962 .

[31]  Wayne Zachary,et al.  Interface Agents in Complex Systems , 1996 .

[32]  Michael D. McNeese,et al.  Cockpit Automation Technology: A Further Look , 1985 .

[33]  Beverly M. Huey,et al.  Human Performance Models for Computer-Aided Engineering , 1990 .

[34]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[35]  Michael E. Atwood,et al.  Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance , 1993, Hum. Comput. Interact..

[36]  Charles W. Hutchins.  A Computer Aided Function Allocation and Evaluation System (CAFES) , 1974 .

[37]  Robert Sutton,et al.  Applications of Human Performance Models to System Design , 1989, Springer US.

[38]  Wayne D. Gray,et al.  Contending with Complexity: The Development and Use of Scaled Worlds as Research Tools , 1998 .