Evaluating the Use of Mobile Devices in Critical Incidents Response: A Microworld Approach

In this work we approach the study of team situation awareness based upon a holistic perspective that integrates the shared and distributed nature of the construct. We studied team situation awareness in the context of critical incidents response management, as it constitutes a valuable asset and yet is continuously challenged by the very nature of the context. We applied a micro world approach as a compromise between controlled laboratory experiments and field studies. Relying on this approach, we studied the impact of mobile applications in the teams' performance and situation awareness, using a helpdesk as an application domain. The obtained results do not indicate a fundamental breakthrough regarding the usage of mobile applications in such contexts. Nevertheless, they provide valuable insights about the team dynamics, situation awareness and communication patterns.

[1]  David B. Kaber,et al.  Effects of physical workload on cognitive task performance and situation awareness , 2008 .

[2]  Erik Hollnagel,et al.  Resilience : The challenge of the unstable , 2006 .

[3]  Endsley,et al.  A model of inter- and intrateam situation awareness: implications for design, training and measurement , 2001 .

[4]  Kazuo Furuta,et al.  An inference method of team situation awareness based on mutual awareness , 2005, Cognition, Technology & Work.

[5]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[6]  L. Comfort,et al.  Managing Crises: Threats, Dilemmas, Opportunities , 2001 .

[7]  Marie-Eve Jobidon,et al.  Team Response to Workload Transition: The Role of Team Structure , 2006 .

[8]  J Swanson,et al.  Business Dynamics—Systems Thinking and Modeling for a Complex World , 2002, J. Oper. Res. Soc..

[9]  N A Stanton,et al.  Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology , 2006, Ergonomics.

[10]  Jens Rasmussen,et al.  Risk management in a dynamic society: a modelling problem , 1997 .

[11]  Winston Bennett,et al.  The Effect of Distributed Practice on Immediate Posttraining, and Long-Term Performance on a Complex Command-and-Control Simulation Task , 2010 .

[12]  B. Brehmer,et al.  Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study , 1993 .

[13]  Kip Smith,et al.  Situation Awareness Is Adaptive, Externally Directed Consciousness , 1995, Hum. Factors.

[14]  Eser Kandogan,et al.  Field studies of computer system administrators: analysis of system management tools and practices , 2004, CSCW.

[15]  G. Bedny,et al.  Theory of Activity and Situation Awareness , 1999 .

[16]  Mary M. Omodei,et al.  The Fire Chief microworld generating program: An illustration of computer-simulated microworlds as an experimental paradigm for studying complex decision-making behavior , 1995 .

[17]  James T. Reason,et al.  Managing the risks of organizational accidents , 1997 .

[18]  Stephen A. Stumpf,et al.  Microworlds and Simuworlds: Practice Fields for the Learning Organization , 1996 .

[19]  Pedro Antunes,et al.  Supporting experimental collaborative systems evaluation , 2011, Proceedings of the 2011 15th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[20]  Nancy G. Leveson,et al.  A new accident model for engineering safer systems , 2004 .

[21]  T. Kanno,et al.  Resilience of Emergency Response Systems , 2006 .

[22]  H. W. Heinrich.  Industrial Accident Prevention , 1941 .

[23]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[24]  Bartel Van de Walle,et al.  IT for Corporate Crisis Management: Findings from a Survey in 6 different Industries on Management Attention, Intention and Actual Use , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[25]  Cleotilde Gonzalez,et al.  The use of microworlds to study dynamic decision making , 2005, Comput. Hum. Behav..

[26]  Pedro Antunes,et al.  Developing a Mobile Collaborative Tool for Business Continuity Management , 2011, J. Univers. Comput. Sci..

[27]  Annette Kluge,et al.  The effects of heuristic rule training on operator performance in a simulated process control environment , 2008, Ergonomics.

[28]  John D. Sterman,et al.  System Dynamics: Systems Thinking and Modeling for a Complex World , 2002 .

[29]  Guy H. Walker,et al.  What really is going on? Review of situation awareness models for individuals and teams , 2008 .

[30]  Ted Nettelbeck,et al.  Investigating the construct validity associated with microworld research: A comparison of performance under different management structures across expert and non-expert naturalistic decision-making groups , 2006 .

[31]  Thomas D. Hardiman,et al.  A Comparative Analysis of Sagat and Sart for Evaluations of Situation Awareness , 1998 .

[32]  J. Funke.  Dynamic systems as tools for analysing human judgement , 2001 .

[33]  John D. Sterman,et al.  Business dynamics : systems thinking and modelling for acomplex world , 2002 .

[34]  J. Schraagen,et al.  Improving Decision Making in Crisis Response through Critical Thinking Support , 2008 .

[35]  D O'Hare,et al.  Situational awareness ability and cognitive skills training in a complex real-world task , 2007, Ergonomics.

[36]  B. V. D. Walle,et al.  Proceedings of the 4th International Conference on Information Systems for Crisis Response and Management , 2007 .

[37]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[38]  Wayne D. Gray.  Simulated task environments: The role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. , 2002 .

[39]  B. Brehmer,et al.  Micro-worlds and the circular relation between people and their environment , 2005 .