The development of a tool to predict team performance.

The paper describes the development of a tool to predict quantitatively the success of a team when executing a process. The tool was developed for the UK defence industry, though it may be useful in other domains. It is expected to be used by systems engineers in initial stages of systems design, when concepts are still fluid, including the structure of the team(s) which are expected to be operators within the system. It enables answers to be calculated for questions such as "What happens if I reduce team size?" and "Can I reduce the qualifications necessary to execute this process and still achieve the required level of success?". The tool has undergone verification and validation; it predicts fairly well and shows promise. An unexpected finding is that the tool creates a good a priori argument for significant attention to Human Factors Integration in systems projects. The simulations show that if a systems project takes full account of human factors integration (selection, training, process design, interaction design, culture, etc.) then the likelihood of team success will be in excess of 0.95. As the project derogates from this state, the likelihood of team success will drop as low as 0.05. If the team has good internal communications and good individuals in key roles, the likelihood of success rises towards 0.25. Even with a team comprising the best individuals, p(success) will not be greater than 0.35. It is hoped that these results will be useful for human factors professionals involved in systems design.

[1]  E. Mayo The Human Problems of an Industrial Civilization , 1934, Nature.

[2]  E. M. Dougherty,et al.  Human reliability analysis - where shouldst thou turn? , 1990 .

[3]  B. Kirwan A comparative evaluation of five human reliability assessment techniques , 1988 .

[4]  A. Paul Hare,et al.  Roles, Relationships, And Groups In Organizations: Some Conclusions And Recommendations , 2003 .

[5]  H. Skipton Leonard,et al.  From scientific management through fun and games to high performing teams: A historical perspective on consulting to team-based organizations. , 2000 .

[6]  L. Thurstone The Vectors of Mind , 1935 .

[7]  James D. McKeen,et al.  Re-engineering the corporation: where does IS fit in? , 1993, [1993] Proceedings of the Twenty-sixth Hawaii International Conference on System Sciences.

[8]  P C Cacciabue,et al.  Human factors impact on risk analysis of complex systems. , 2000, Journal of hazardous materials.

[9]  Chris W. Johnson,et al.  The interaction between safety culture and degraded modes: A survey of national infrastructures for air traffic management , 2009 .

[10]  R. E. Christal,et al.  Recurrent personality factors based on trait ratings. , 1992, Journal of personality.

[11]  D. Mcgregor,et al.  The Human Side of Enterprise , 1960 .

[12]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[13]  Sidney Dekker,et al.  Why we need new accident models , 2004 .

[14]  W. G. Cochran Some Methods for Strengthening the Common χ 2 Tests , 1954 .

[15]  E. Trist,et al.  Some Social and Psychological Consequences of the Longwall Method of Coal-Getting , 1951 .

[16]  W. T. Norman,et al.  Toward an adequate taxonomy of personality attributes: replicated factors structure in peer nomination personality ratings. , 1963, Journal of abnormal and social psychology.

[17]  Daniel R. Ilgen,et al.  Enhancing the Effectiveness of Work Groups and Teams , 2006, Psychological science in the public interest : a journal of the American Psychological Society.

[18]  Ken Eason,et al.  Information technology and organisational change , 1988 .

[19]  J. McGrath Groups: Interaction and Performance , 1984 .

[20]  David H. Gustafson,et al.  Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes , 1976 .

[21]  E. Sundstrom,et al.  Work teams: Applications and effectiveness. , 1990 .

[22]  H Sackman,et al.  Delphi Assessment: Expert Opinion, Forecasting, and Group Process , 1974 .

[23]  T. G. Cummings,et al.  A Methodological Critique of Fifty-Eight Selected Work Experiments , 1977 .

[24]  Barry Kirwan,et al.  Nuclear Action Reliability Assessment (NARA): A Data-Based HRA Tool , 2005 .

[25]  J. C. Williams,et al.  Validation of human reliability assessment techniques , 1985 .

[26]  E. N. Corlett,et al.  Handbook of human reliability analysis with emphasis on nuclear power plant applications: A.D. Swain and H.E. Guttmann Draft report for interim use and comment. Office of Nuclear Regulatory Research, US Regulatory Commission, Washington DC 20555, pp 440 , 1981 .

[27]  Jonathan Benn 'Soft metrics': development and application of a framework for the measurement of human and organisational factors in projects , 2004 .

[28]  H. Hendrick Good Ergonomics Is Good Economics , 1996 .

[29]  Murray Sinclair,et al.  Decision‐making systems and the product‐to‐service shift , 2009 .

[30]  M A Sinclair,et al.  Ergonomics issues in future systems , 2007, Ergonomics.

[31]  Nasrin R. Khalili What are Hazardous Materials , 2008 .

[32]  Gudela Grote,et al.  KOMPASS: a method for complementary function allocation in automated work systems , 2000, Int. J. Hum. Comput. Stud..

[33]  J. Wreathall,et al.  Knowledge-base for the new human reliability analysis method, A Technique for Human Error Analysis (ATHEANA) , 1996 .

[34]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[35]  J. Cook,et al.  Scales for the measurement of some work attitudes and aspects of psychological well‐being , 1979 .

[36]  Alan D. Swain,et al.  Human reliability analysis: Need, status, trends and limitations , 1990 .

[37]  A. V. D. Ven,et al.  Determinants of Coordination Modes within Organizations , 1976 .

[38]  B Robbins,et al.  The structure of personality , 1975, American journal of psychoanalysis.

[39]  Guy H. Walker,et al.  A review of sociotechnical systems theory: a classic concept for new command and control paradigms , 2008 .

[40]  E. Salas,et al.  Methods, tools, and strategies for team training. , 1997 .

[41]  C W Clegg,et al.  Sociotechnical principles for system design. , 2000, Applied ergonomics.

[42]  Barry Kirwan,et al.  Human Reliability Assessment , 2008 .

[43]  Jim Christy,et al.  The price of power , 1984 .

[44]  Dennis J. Devine A Review and Integration of Classification Systems Relevant to Teams in Organizations , 2002 .

[45]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[46]  Sidney Dekker,et al.  Ten Questions About Human Error : A New View of Human Factors and System Safety , 2004 .

[47]  S. Parker Work and the Nature of man , 1969 .

[48]  James J. Higgins,et al.  A literature survey of the human reliability component in a man-machine system , 1988 .

[49]  Linda C. Angell,et al.  Personality Heterogeneity in Teams , 2003 .

[50]  G. Hofstede,et al.  Culture′s Consequences: International Differences in Work-Related Values , 1980 .

[51]  Erik Hollnagel,et al.  HUMAN RELIABILITY ASSESSMENT IN CONTEXT , 2005 .

[52]  John A. Forester,et al.  The application of ATHEANA: a technique for human error analysis , 1997, Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, 1997. 'Global Perspectives of Human Factors in Power Generation'.

[53]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[54]  John E. Mathieu,et al.  Task and aggregation issues in the analysis and assessment of team performance. , 1997 .

[55]  Felix Redmill,et al.  The Safety of Systems - Proceedings of the Fifteenth Safety-critical Systems Symposium, Bristol, UK, February 13-15, 2007 , 2007, SSS.

[56]  Barry Kirwan,et al.  CARA: A Human Reliability Assessment Tool for Air Traffic Safety Management - Technical Basis and Preliminary Architecture , 2007, SSS.

[57]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method : CREAM , 1998 .

[58]  Peter Essens,et al.  Military Command Team Effectiveness: Model and Instrument for Assessment and Improvement (L'efficacite des Equipes de Commandement Militaires: un Modele et un Instrument Pour L'evaluation et L'amelioration) , 2005 .

[59]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[60]  G. Stewart A Meta-Analytic Review of Relationships Between Team Design Features and Team Performance , 2006 .

[61]  Enid Mumford,et al.  Redesigning Human Systems , 2003 .

[62]  Barry Kirwan,et al.  A Guide to Practical Human Reliability Assessment , 1994 .

[63]  Erik Hollnagel,et al.  Reliability analysis and operator modelling , 1996 .

[64]  Myers,et al.  Gifts Differing: Understanding Personality Type , 1980 .

[65]  W. Pasmore,et al.  Sociotechnical Systems: A North American Reflection on Empirical Studies of the Seventies , 1982 .

[66]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[67]  J. E. Groves,et al.  Made in America: Science, Technology and American Modernist Poets , 1989 .

[68]  Holly Arrow,et al.  Small Groups as Complex Systems: Formation, Coordination, Development, and Adaptation , 2000 .

[69]  H. G. Maule Productivity and Social Organization: The Ahmedabad Experiment , 1958 .

[70]  Charles Perrow,et al.  Normal accidents : living with high-risk technologies : with a new afterword and a postscript on the Y2K problem , 2011 .

[71]  Robert M. McIntyre,et al.  Toward an Understanding of Team Performance and Team Cohesion Over Time Through the Lens of Time Series Analysis , 2003 .

[72]  Murray R. Barrick,et al.  FIVE REASONS WHY THE “BIG FIVE” ARTICLE HAS BEEN FREQUENTLY CITED , 1998 .

[73]  Dennis J. Devine,et al.  Do Smarter Teams Do Better , 2001 .

[74]  Sidney Dekker,et al.  The Field Guide to Human Error Investigations , 2006 .

[75]  E. Sundstrom,et al.  Work groups: From the Hawthorne studies to work teams of the 1990s and beyond. , 2000 .

[76]  B. Kirwan,et al.  SLIM-MAUD: an approach to assessing human error probabilities using structured expert judgment. Volume I. Overview of SLIM-MAUD , 1984 .

[77]  D. Eden,et al.  Effects of crew composition on crew performance: Does the whole equal the sum of its parts? , 1985 .

[78]  K. Lewin,et al.  Group decision and social change. , 1999 .

[79]  Victor C. X. Wang Principles of Scientific Management and Occupational Analysis , 2011 .

[80]  B. Tuckman DEVELOPMENTAL SEQUENCE IN SMALL GROUPS. , 1965, Psychological bulletin.

[81]  Enid Mumford,et al.  Effective systems design and requirements analysis : the ETHICS approach , 1995 .

[82]  A. J. Grimes Normal Accidents: Living with High Risk Technologies , 1985 .

[83]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[84]  Joel Cutcher-Gershenfeld,et al.  Engineering resilience into safety-critical systems , 2012 .

[85]  C. Depken,et al.  Peer Effects in Team Sports: Empirical Evidence From NCAA Relay Teams , 2007 .

[86]  G M Hägg Corporate Initiatives in Ergonomics , 2003, Applied ergonomics.

[87]  Erich Fromm Excerpt of Koestler, A., 1967.: The Ghost in The Machine, London (Arkana Books). , 1967 .