Never blame the umpire – a review of Situation Awareness models and methods for examining the performance of officials in sport

Abstract As sport becomes more complex, there is potential for ergonomics concepts to help enhance the performance of sports officials. The concept of Situation Awareness (SA) appears pertinent given the requirement for officials to understand what is going on in order to make decisions. Although numerous models exist, none have been applied to examine officials, and only several recent examples have been applied to sport. This paper examines SA models and methods to identify if any have applicability to officials in sport (OiS). Evaluation of the models and methods identified potential applications of individual, team and systems models of SA. The paper further demonstrates that the Distributed Situation Awareness model is suitable for studying officials in fastball sports. It is concluded that the study of SA represents a key area of multidisciplinary research for both ergonomics and sports science in the context of OiS. Practitioner Summary: Despite obvious synergies, applications of cognitive ergonomics concepts in sport are sparse. This is especially so for Officials in Sport (OiS). This article presents an evaluation of Situation Awareness models and methods, providing practitioners with guidance on which are the most suitable for OiS system design and evaluation.

[1]  R. M. Taylor,et al.  Situational Awareness Rating Technique (Sart): The Development of a Tool for Aircrew Systems Design , 2017 .

[2]  A. J. Masys,et al.  A systemic perspective of situation awareness: An analysis of the 2002 mid‐air collision over Überlingen, Germany , 2005 .

[3]  Kazuo Furuta,et al.  An evaluation method of team situation awareness based on mutual belief , 2008, Cognition, Technology & Work.

[4]  David O'Hare,et al.  The psychological and performance demands of association football refereeing. , 2006 .

[5]  C. Sève,et al.  Temporal Aspects of Team Cognition: A Case Study on Concerns Sharing Within Basketball , 2012 .

[6]  P M Salmon,et al.  Representing situation awareness in collaborative systems: A case study in the energy distribution domain , 2008, Ergonomics.

[7]  J Bourbousson,et al.  Description of dynamic shared knowledge: an exploratory study during a competitive team sports interaction , 2011, Ergonomics.

[8]  Guy H. Walker,et al.  Is it really better to share? Distributed situation awareness and its implications for collaborative system design , 2010 .

[9]  Cyril Bossard,et al.  Defensive Soccer Players’ Decision Making , 2014 .

[10]  Kazuo Furuta,et al.  An inference method of team situation awareness based on mutual awareness , 2005, Cognition, Technology & Work.

[11]  Brendan Lay,et al.  Perceptual and decision-making skills of Australian football umpires , 2011 .

[12]  Cédric Buche,et al.  Investigate naturalistic decision-making of a workgroup in dynamic situation. From the modelling to the design of a training virtual environment , 2013 .

[13]  Edwin Hutchins,et al.  How a Cockpit Remembers Its Speeds , 1995, Cogn. Sci..

[14]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[15]  Anne-Claire Macquet,et al.  Recognition Within the Decision-Making Process: A Case Study of Expert Volleyball Players , 2009 .

[16]  Géraldine Rix-Lièvre,et al.  La performance arbitrale : de son étude à son développement Refereeing performance: From study to development , 2014 .

[17]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[18]  Bjørn Sætrevik,et al.  The “Similarity Index” as an Indicator of Shared Mental Models and Situation Awareness in Field Studies , 2014 .

[19]  Kim-Phuong L. Vu,et al.  Mechanisms for the acquisition of situation awareness in situated agents , 2012 .

[20]  Neville A Stanton,et al.  From ethnography to the EAST method: A tractable approach for representing distributed cognition in Air Traffic Control , 2010, Ergonomics.

[21]  Neville Stanton,et al.  Situation awareness measurement: a review of applicability for C4i environments. , 2006, Applied ergonomics.

[22]  Jim McLennan,et al.  The Role of Prepriming in Recognition-Primed Decisionmaking , 1996 .

[23]  Edmond W. Israelski,et al.  Special Issue Preface , 1995, Hum. Factors.

[24]  Michael D. Matthews,et al.  Assessing Situation Awareness in Field Training Exercises , 2002 .

[25]  Enrique Navarro,et al.  Effect of positioning on the accuracy of decision making of association football top-class referees and assistant referees during competitive matches , 2012, Journal of sports sciences.

[26]  Michael A. Vidulich,et al.  Testing a Subjective Metric of Situation Awareness , 1991 .

[27]  Guy H. Walker,et al.  Human Factors Methods and Sports Science: A Practical Guide , 2009 .

[28]  Guy H. Walker,et al.  Event analysis of systemic teamwork (EAST): a novel integration of ergonomics methods to analyse C4i activity , 2006, Ergonomics.

[29]  Getting Them on the Same Page: A Method to Study the Consistency of Coaches' and Athletes' Situation Understanding During Training Sessions and Competitions , 2013 .

[30]  Josef F. Krems,et al.  A Comprehension Based Cognitive Model of Situation Awareness , 2009, HCI.

[31]  Kim-Phuong L. Vu,et al.  A situated approach to the acquisition of shared SA in team contexts , 2014 .

[32]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[33]  Guy H. Walker,et al.  Genotype and phenotype schemata and their role in distributed situation awareness in collaborative systems , 2009 .

[34]  Neville A Stanton,et al.  Using the Event Analysis of Systemic Teamwork (EAST) to explore conflicts between different road user groups when making right hand turns at urban intersections , 2014, Ergonomics.

[35]  C M Kozma,et al.  Managing risks. , 1997, Managed care interface.

[36]  Guy H. Walker,et al.  Measuring Situation Awareness in complex systems: Comparison of measures study , 2009 .

[37]  David O'Hare,et al.  The effects of individual differences, prior experience and cognitive load on the transfer of dynamic decision-making performance , 2014, Ergonomics.

[38]  Neville A Stanton,et al.  Exploring schema-driven differences in situation awareness between road users: an on-road study of driver, cyclist and motorcyclist situation awareness , 2014, Ergonomics.

[39]  Robert Evans,et al.  Sport-decision aids and the “CSI-effect”: Why cricket uses Hawk-Eye well and tennis uses it badly , 2012, Public understanding of science.

[40]  N A Stanton,et al.  Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology , 2006, Ergonomics.

[41]  S. Gronlund,et al.  Situation Awareness , 2006 .

[42]  E. Salas,et al.  Team cognition and expert teams: Developing insights from cross –disciplinary analysis of exceptional teams , 2006 .

[43]  Géraldine Rix-Lièvre,et al.  Referee cognition as it occurs : different kind of judgment acts , 2011 .

[44]  Ian Angus,et al.  The Collected Essays, Journalism and Letters of George Orwell. Volume I, An Age like This, 1920-1940; Volume II, My Country Right or Left, 1940-1943; Volume III, As I Please, 1943-1945; Volume IV, In Front of Your Nose, 1945-1950 , 1969 .

[45]  James T. Reason,et al.  Managing the risks of organizational accidents , 1997 .

[46]  Harold Maurice Collins,et al.  The Philosophy of Umpiring and the Introduction of Decision-Aid Technology , 2010 .

[47]  Eduardo Salas,et al.  Situation Awareness in Team Performance: Implications for Measurement and Training , 1995, Hum. Factors.

[48]  Guy H. Walker,et al.  A systemic approach to accident analysis: A case study of the Stockwell shooting , 2010, Ergonomics.

[49]  C. Sève,et al.  Team Coordination in Basketball: Description of the Cognitive Connections Among Teammates , 2010 .

[50]  A. Macquet,et al.  Naturalistic decision-making in expert badminton players , 2007, Ergonomics.

[51]  Shayne Loft,et al.  Situation Awareness Measures for Simulated Submarine Track Management , 2015, Hum. Factors.

[52]  Johan Wagemans,et al.  Perceptual-cognitive skills in offside decision making: expertise and training effects. , 2010, Journal of sport & exercise psychology.

[53]  Félix Guillén,et al.  A Conceptual Model of Referee Efficacy , 2010, Front. Psychology.

[54]  Bob Morris,et al.  Training Accurate and CoherentDecision Making inRugby Union Referees , 2005 .

[55]  Dave Collins,et al.  A Naturalistic Approach to Training Accurate and Coherent Decision Making in Rugby Union Referees , 2005 .

[56]  Greg Atkinson,et al.  Sport, leisure and ergonomics VI , 2009, Ergonomics.

[57]  Neville A. Stanton,et al.  Situation awareness and safety: Contribution or confusion? Situation awareness and safety editorial , 2013 .

[58]  Guy H. Walker,et al.  What really is going on? Review of situation awareness models for individuals and teams , 2008 .

[59]  Neville A Stanton,et al.  Representing distributed cognition in complex systems: how a submarine returns to periscope depth , 2014, Ergonomics.

[60]  G. Bedny,et al.  Theory of Activity and Situation Awareness , 1999 .

[61]  C. Bossard,et al.  Formes, contenus et évolution du partage au sein d'une équipe de sport de haut niveau , 2013 .

[62]  Werner Retschitzegger,et al.  A tour of BeAware - A situation awareness framework for control centers , 2014, Inf. Fusion.

[63]  G. Hicks,et al.  Collected Essays , 1975, Nature.

[64]  Waldemar Karwowski,et al.  The situational reflection of reality in activity theory and the concept of situation awareness in cognitive psychology , 2004 .

[65]  Géraldine Rix-Lièvre,et al.  Naturalistic decision making and emotion in refereeing: affect at the heart of judgment , 2013 .

[66]  R M Laing,et al.  Differences in wearer response to garments for outdoor activity , 2008, Ergonomics.

[67]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[68]  J Martin,et al.  Activity analysis of English premiership rugby football union refereeing , 2001, Ergonomics.

[69]  S. Giessner,et al.  How Embodied Cognitions Affect Judgments: Height-Related Attribution Bias in Football Foul Calls , 2010, Journal of sport & exercise psychology.

[70]  Neville A. Stanton,et al.  Commentary on the paper by Heimrich Kanis entitled ‘Reliability and validity of findings in ergonomics research’: where is the methodology in ergonomics methods? , 2014 .

[71]  David W. Eccles,et al.  The dynamics of team coordination: A social network analysis as a window to shared awareness , 2015 .

[72]  C. Sève,et al.  Analysis of contextual information sharing during table tennis matches: An empirical study of coordination in sports , 2009 .

[73]  Jessica L. Wildman,et al.  Measuring Cognition in Teams , 2014, Hum. Factors.

[74]  Annejet P. Meijler,et al.  The Evaluation Method , 1987 .

[75]  U. Neisser.  Cognitive Psychology. (Book Reviews: Cognition and Reality. Principles and Implications of Cognitive Psychology) , 1976 .

[76]  David O'Hare,et al.  Physical performance and decision making in association football referees: a naturalistic study , 2009 .

[77]  Anne-Claire Macquet,et al.  Do the coach and athlete have the same "picture" of the situation? Distributed Situation Awareness in an elite sport context. , 2014, Applied ergonomics.

[78]  John Patrick,et al.  The role of situation awareness in sport , 2004 .

[79]  Kip Smith,et al.  Situation Awareness Is Adaptive, Externally Directed Consciousness , 1995, Hum. Factors.

[80]  G. Maio,et al.  Referees' use of heuristics: The moderating impact of standard of competition , 2009, Journal of sports sciences.

[81]  T. Connolly,et al.  The reinvention of decision making. , 1993 .

[82]  C. Buss,et al.  Children's Brain Development Benefits from Longer Gestation , 2011, Front. Psychology.

[83]  Jacques Theureau,et al.  Course-of-Action Analysis and Course-of-Action-Centered Design , 2003 .

[84]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .