An Alternative Front End Analysis Strategy for Complex Systems

Abstract : This initial phase of a three phase research effort designs and recommends an alternative front end analysis (FEA) strategy for evolving, highly automated, complex systems that rely upon multilevel command and control integration. This research is in response to growing concerns that current task-based FEA processes are increasingly insufficient to identify performance and training requirements for complex, highly automated systems. Analytic strategies were identified by examining existing literature pertaining to air defense training and performance, FEA approaches, and complex task performance and training. Two alternative FEA strategies were developed, leveraging known issues and research findings. The approach recommended to the U.S. Army Air Defense School incorporates expertise-based and collective team analyses into the Army's established task-based FEA approach. This approach was approved by the Air Defense School for the next phase of this research, i.e. applying the strategy to current Patriot missile training. Given the scope and depth of Patriot missile training, this assessment will be limited to air battle management training. The results from this case use application will be presented in a separate report following completion of the second phase of this research.

[1]  S. Kozlowski Training and developing adaptive teams: Theory, principles, and research. , 1998 .

[2]  R J Adams,et al.  Introduction to cognitive processes of expert pilots. , 2000, Human performance in extreme environments : the journal of the Society for Human Performance in Extreme Environments.

[3]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[4]  M. Chi Knowledge structures and memory development. , 1978 .

[5]  John K. Hawley,et al.  Looking Back at 20 Years of MANPRINT on Patriot: Observations and Lessons , 2007 .

[6]  E. Salas,et al.  Team cognition : understanding the factors that drive process and performance , 2004 .

[7]  Joseph D. Hagman,et al.  Retention of Military Tasks: A Review , 1983 .

[8]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[9]  Stephanie C Payne,et al.  Measuring team-related expertise in complex environments. , 1998 .

[10]  John K. Hawley,et al.  Developing Effective Adaptive Missile Crews and Command and Control Teams for Air and Missile Defense Systems , 2007 .

[11]  Sallie J. Weaver,et al.  Integrating the science of team training: guidelines for continuing education. , 2010, The Journal of continuing education in the health professions.

[12]  Richard E. Clark,et al.  Blueprints for complex learning: The 4C/ID-model , 2002 .

[13]  Kenneth A. Yates,et al.  TOWARDS A TAXONOMY OF COGNITIVE TASK ANALYSIS METHODS: A SEARCH FOR COGNITION AND TASK ANALYSIS INTERACTIONS , 2007 .

[14]  Dorothea P. Simon,et al.  Individual Differences in Solving Physics Problems (1978) , 1978 .

[15]  Guy H. Walker,et al.  Distributed situational awareness , 2005 .

[16]  Sallie E. Gordon Front-End Analysis for Expert System Design , 1991 .

[17]  John K. Hawley,et al.  Training for Effective Human Supervisory Control of Air and Missile Defense Systems , 2006 .

[18]  Albert A. Nofi Defining and Measuring Shared Situational Awareness , 2000 .

[19]  Kent L. Gustafson,et al.  Paradigms in the theory and practice of education and training design , 2004 .

[20]  S. Kozlowski,et al.  Multilevel Theory, Research, a n d M e t h o d s i n Organizations Foundations, Extensions, and New Directions , 2022 .

[21]  Robert L. Helmreich,et al.  Why crew resource management? Empirical and theoretical bases of human factors training in aviation. , 1993 .

[22]  Gary Klein,et al.  Rapid Decision Making on the Fire Ground , 1986 .

[23]  P. Kirschner,et al.  Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning , 2003 .

[24]  Tuija Valkeavaara,et al.  "Sailing in Calm Waters Doesn't Teach": Constructing Expertise through Problems in Work--The Case of Finnish Human Resource Developers. , 1999 .

[25]  Peter McGeorge,et al.  Biomedical Knowledge in Diagnostic Thinking: The Case of Electrocardiogram (ECG) Interpretation , 1997 .

[26]  David H. Jonassen,et al.  Designing for decision making , 2012 .

[27]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[28]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[29]  Adel Guitouni,et al.  Joint Command Decision Support System , 2011 .

[30]  M. Endsley The role of situation awareness in naturalistic decision making , 1997 .

[31]  Conrad Gail Bills,et al.  High Engagement Strategies in Simulation and Gaming , 2010 .

[32]  Joost Lowyck,et al.  Supporting the instructional design process for team training , 2007, Comput. Hum. Behav..

[33]  Peter J. Fadde Instructional design for advanced learners: training recognition skills to hasten expertise , 2009 .

[34]  M. Chi Two Approaches to the Study of Experts' Characteristics , 2006 .

[35]  Fred Paas,et al.  Instructional design for advanced learners: Establishing connections between the theoretical frameworks of cognitive load and deliberate practice , 2005 .

[36]  Walter Schneider,et al.  Training High-Performance Skills: Fallacies and Guidelines , 1985 .

[37]  J. Yates,et al.  The Cambridge Handbook of Expertise and Expert Performance: Decision-Making Expertise , 2006 .

[38]  R. Clark,et al.  Cognitive task analysis for training , 1996 .

[39]  John B. Best,et al.  Cognitive psychology, 5th ed. , 1999 .

[40]  R. Clark,et al.  Cognitive task analysis-based design and authoring software for simulation training. , 2013, Military medicine.

[41]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[42]  N A Stanton,et al.  Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology , 2006, Ergonomics.

[43]  John K. Hawley,et al.  The Human Side of Automation: Lessons for Air Defense Command and Control , 2005 .

[44]  Eduardo Salas,et al.  Complexity in Collaboration: Developing an Understanding of Macrocognition in Teams through Examination of Task Complexity , 2008 .

[45]  Peter J. Fadde Accelerating the Acquisition of Intuitive Decision-Making through Expertise-Based Training (XBT) , 2013 .

[46]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[47]  Alexander J. Romiszowski,et al.  Designing Instructional Systems , 1980 .

[48]  Mica R. Endsley,et al.  Level of Automation: Integrating Humans and Automated Systems , 1997 .

[49]  S. Chipman,et al.  Introduction to Cognitive Task Analysis , 2000 .

[50]  John K. Hawley,et al.  Developing Effective Human Supervisory Control for Air and Missile Defense Systems , 2006 .

[51]  S. Mohammed,et al.  Team Mental Model: Construct or Metaphor? , 1994 .

[52]  Timothy A. Post,et al.  Problem-Solving Skill in the Social Sciences , 1983 .

[53]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[54]  Jennifer J. Vogel-Walcutt,et al.  Instructional strategies framework for military training systems , 2013, Comput. Hum. Behav..

[55]  N. Charness,et al.  Expert Performance Its Structure and Acquisition , 2002 .