Modelling environmental and cognitive factors to predict performance in a stressful training scenario on a naval ship simulator

Professionals working in risky or emergency situations have to make very accurate decisions, while the quality of the decisions might be affected by the stress that these situations bring about. Integrating task feedback and biofeedback into computer-based training environments could improve trainees’ stress-coping behaviour. This paper presents and assesses a refined version of the cognitive performance and error (COPE) model that describes the effects of stressful events on decisions as a foundation for such a support tool. Within a high-fidelity simulator of a ship’s bridge at the Royal Netherlands Naval College, students of the naval college (n = 10) were observed while completing a 2-h-long shadowing and boarding operation combined with a search-and-rescue operation. For every action, variables were measured: objective and subjective task demand, challenge and threat appraisal, and arousal based on heart rate and heart rate variability. The data supported the COPE model and were used to create predictive models. The variables could provide minute-by-minute predictions of performance that can be divided into performance rated by experts and errors. The predictions for performance rated by experts correlated with the observed data (r = 0.77), and 68.3 % of the predicted errors were correct. The error predictions concern the chances of making specific errors of communication, planning, speed, and task allocation. These models will be implemented into a real-time feedback system for trainees performing in stressful simulated training tasks.

[1]  François Bernier,et al.  Using Biofeedback while Immersed in a Stressful Videogame Increases the Effectiveness of Stress Management Skills in Soldiers , 2012, PloS one.

[2]  Birgitta Kylesten Dynamic decision-making on an operative level: a model including preconditions and working method , 2012, Cognition, Technology & Work.

[3]  L. Mulder Measurement and analysis methods of heart rate and respiration for use in applied environments , 1992, Biological Psychology.

[4]  Julie-Ann Sime,et al.  Designing emergency response training : seven ways to reduce stress. , 2007 .

[5]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[6]  Peter Thunholm,et al.  Decision-making style : habit, style or both? , 2004 .

[7]  M. Brand,et al.  Decision making under stress: A selective review , 2012, Neuroscience & Biobehavioral Reviews.

[8]  Johanna Helena Kerstholt,et al.  The effect of time pressure on decision-making behaviour in a dynamic task environment , 1994 .

[9]  Peter Thunholm,et al.  Decision-making styles and physiological correlates of negative stress: is there a relation? , 2008, Scandinavian journal of psychology.

[10]  Dylan D. Schmorrow,et al.  Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience , 2016, Lecture Notes in Computer Science.

[11]  Filiz Ozel,et al.  Time pressure and stress as a factor during emergency egress , 2001 .

[12]  Joseph S. Valacich,et al.  The Influence of Task Interruption on Individual Decision Making: An Information Overload Perspective , 1999 .

[13]  Richard S. Lazanis Stress and emotion, a new synthesis , 1999 .

[14]  J. Forgas Mood and judgment: the affect infusion model (AIM). , 1995, Psychological bulletin.

[15]  Tricia Z. King,et al.  Shooting behaviour: How working memory and negative emotionality influence police officer shoot decisions , 2009 .

[16]  James Reason,et al.  Cognitive Aids in Process Environments: Prostheses or Tools? , 1987, Int. J. Man Mach. Stud..

[17]  Rajeev Kumar,et al.  Receiver operating characteristic (ROC) curve for medical researchers , 2011, Indian pediatrics.

[18]  T. Connolly,et al.  The reinvention of decision making. , 1993 .

[19]  J. C. Byers,et al.  Comparison of Four Subjective Workload Rating Scales , 1992 .

[20]  R. Delahaij,et al.  Coping under acute stress: The role of person characteristics , 2010 .

[21]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[22]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[23]  G. Keinan,et al.  Decision making under stress: Scanning of alternatives under physical threat , 1987 .

[24]  James E. Driskell,et al.  Stress exposure training. , 1998 .

[25]  Tibor Bosse,et al.  An Agent Model for a Human's Functional State and Performance , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[26]  Mikael Forsman,et al.  Consistency in physiological stress responses and electromyographic activity during induced stress exposure in women and men , 2004, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[27]  Tom Kontogiannis,et al.  Stress and team performance: principles and challenges for intelligent decision aids , 1999 .

[28]  安藤 寛,et al.  Cross-Validation , 1952, Encyclopedia of Machine Learning and Data Mining.

[29]  G. Hockey,et al.  Effects of time-pressure on decision-making under uncertainty: changes in affective state and information processing strategy. , 2000, Acta psychologica.

[30]  Raanan Lipshitz,et al.  Why classical decision theory is an inappropriate standard for evaluating and aiding most human decision making. , 1993 .

[31]  J. Dowell Coordination in emergency operations and the tabletop training experience , 1995 .

[32]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[33]  Janet A. Sniezek,et al.  Personality in Extreme Situations: Thinking (or Not) under Acute Stress☆ , 2001 .

[34]  Jens Rasmussen,et al.  Human errors. a taxonomy for describing human malfunction in industrial installations , 1982 .

[35]  Mark A. Neerincx,et al.  Modeling the Cognitive Task Load and Performance of Naval Operators , 2009, HCI.

[36]  Judith M. Orasanu,et al.  Stress and military performance. , 1996 .

[37]  Anthony W. K. Gaillard Stress, productiviteit en gezondheid , 2003 .

[38]  M. Mendl Performing under pressure: stress and cognitive function , 1999 .

[39]  Mark A. Neerincx,et al.  Assembling a synthetic emotion mediator for quick decision making during acute stress , 2012, ECCE.

[40]  J Dowell COORDINATION IN EMERGENCY OPERATIONS AND THE TABLETOP TRAINING EXERCISE , 1995 .

[41]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[42]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[43]  Dwi Hartanto,et al.  Automatic Mechanisms for Measuring Subjective Unit of Discomfort , 2012, Annual Review of Cybertherapy and Telemedicine.

[44]  John-Jules Ch. Meyer,et al.  The design and effect of automated directions during scenario-based training , 2014, Comput. Educ..