Integrating humans with software and systems: Technical challenges and a research agenda

As systems continue to grow in size and complexity, the integration of humans with software and systems poses an ever-growing challenge. The discipline of human-system integration (HSI) is concerned with addressing this challenge from both a managerial and technical perspective. The latter is the focus of this paper. This paper examines this integration challenge from the perspective of capitalizing on the strengths of humans, software, and systems while, at the same time, being mindful of their respective limitations. It presents four key examples of HSI challenges that go beyond the usual human factors requirements. It presents cognitive engineering as a key enabler of HSI and discusses the suitability of the Incremental Commitment Model for introducing human considerations within the complex systems engineering lifecycle. It concludes with a recommendation of specific research thrusts that can accelerate the maturation and adoption of HSI methods, processes, and tools by the software and systems engineering communities. © 2009 Wiley Periodicals, Inc. Syst Eng 13: 232–245, 2010

[1]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[2]  Craig Bonaceto,et al.  A Survey of the Methods and Uses of Cognitive Engineering , 2007 .

[3]  Catherine E. Volpe,et al.  Defining Competencies and Establishing Team Training Requirements , 1995 .

[4]  M. A. Campion,et al.  The Knowledge, Skill, and Ability Requirements for Teamwork: Implications for Human Resource Management , 1994 .

[5]  Richard W. Pew,et al.  Human-system integration in the system development process : a new look , 2007 .

[6]  Azad M. Madni,et al.  Towards a Conceptual Framework for Resilience Engineering , 2009, IEEE Systems Journal.

[7]  Gary Klein,et al.  Naturalistic Decision Making: Implications for Design , 1993 .

[8]  D. Bem,et al.  DIFFUSION OF RESPONSIBILITY AND LEVEL OF RISK TAKING IN GROUPS. , 1963, Journal of abnormal psychology.

[9]  Clint A. Bowers,et al.  Networked simulations: New paradigms for team performance research , 1995 .

[10]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[11]  Andrew P. Sage,et al.  Infusion of cognitive engineering into systems engineering processes and practices , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[12]  Arthur S Blaiwes,et al.  Measurement of Team Behaviors in a Navy Environment , 1986 .

[13]  A Kirlik.  Modeling Strategic Behavior in Human-Automation Interaction: Why an "Aid" Can (and Should) Go Unused , 1993, Human factors.

[14]  J. Charles Kerkering,et al.  Eliciting and Analyzing Expert Judgment, A Practical Guide , 2002, Technometrics.

[15]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[16]  A. M. Madni,et al.  HUMANE: a knowledge-based simulation environment for human-machine function allocation , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[17]  K. Mosier,et al.  Human Decision Makers and Automated Decision Aids: Made for Each Other? , 1996 .

[18]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[19]  Kenneth L. Carper,et al.  Inviting Disaster: Lessons from the Edge of Technology , 2001 .

[20]  Gary Klein,et al.  Implications of the Naturalistic Decision Making Framework for Information Dominance. , 1997 .

[21]  D. P. Baker,et al.  Measuring the Importance of Teamwork: The Reliability and Validity of Job/Task Analysis Indices for Team-Training Design , 1994 .

[22]  J. Kohnen,et al.  Team Effectiveness and Decision Making in Organizations , 1997 .

[23]  Harold R. Booher,et al.  Handbook of Human Systems Integration , 2003 .

[24]  T. Pearson,et al.  Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Sue Milner,et al.  Integrating human factors and systems engineering , 2001 .

[26]  Charles R. McClure,et al.  Measuring and managing performance in organizations , 1997 .

[27]  Stephanie Guerlain.  Factors Influencing the Cooperative Problem-Solving of People and Computers , 1993 .

[28]  A. Tversky,et al.  The simulation heuristic , 1982 .

[29]  S. Chipman,et al.  Introduction to Cognitive Task Analysis , 2000 .

[30]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[31]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[32]  A. Tversky,et al.  Who accepts Savage's axiom? , 1974 .

[33]  Richard E. Redding.  Perspectives on Cognitive Task-Analysis: The State of the State of the Art , 1989 .

[34]  Jennifer L. Rochlis,et al.  Human Systems Integration (HSI) at NASA , 2012 .

[35]  Maarten Sierhuis,et al.  Formal verification of human-robot teamwork , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[36]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[37]  Andrew P. Sage,et al.  Case studies of systems engineering and management in systems acquisition , 2004, Syst. Eng..

[38]  N B Sarter,et al.  LEARNING FROM AUTOMATION SURPRISES AND "GOING SOUR" ACCIDENTS. IN: COGNITIVE ENGINEERING IN THE AVIATION DOMAIN , 2000 .

[39]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[40]  George R. S. Weir,et al.  ON MAN-MACHINE SYSTEMS , 2007 .

[41]  Thomas B. Sheridan,et al.  The Art of Successfully Applying Human Systems Integration , 2008 .

[42]  David Meister.  Conceptual Aspects of Human Factors , 1989 .

[43]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[44]  M. Azad,et al.  The role of human factors in expert systems design and acceptance , 1988 .

[45]  D. Bem,et al.  Group influence on individual risk taking. , 1962, Journal of abnormal and social psychology.

[46]  Kenneth R. Hammond,et al.  Human Judgment and Social Policy: Irreducible Uncertainty, Inevitable Error, Unavoidable Injustice , 2000 .

[47]  A. M. Madni,et al.  Humane: A designer's assistant for modeling and evaluating function allocation options , 1988 .