Criteria for qualitative methods in human reliability analysis

Abstract The qualitative analysis steps in Human Reliability Analysis (HRA) have received little attention in the HRA methods and in the general literature on HRA. The purpose of this paper is to investigate which quality criteria for qualitative research exist and if they can be useful as quality criteria in HRA. To find the criteria for qualitative research, a literature review was performed that covered a broad range of criteria for qualitative research. A thematic analysis was then used to sort and present the different criteria found in different papers and book chapters. Quality criteria for qualitative research were found in the following steps: presenting the background of the study, selecting and presenting a sample, qualitative data collection, qualitative data analysis, credibility/reliability checks, reflexivity and identification of possible bias, and evaluation of ethics considerations. It is discussed how these qualitative criteria could improve HRA and be guidelines for analysts and reviewers of HRAs.

[1]  R. Elliott,et al.  Evolving guidelines for publication of qualitative research studies in psychology and related fields. , 1999, The British journal of clinical psychology.

[2]  J. Drisko.  Strengthening Qualitative Studies and Reports , 1997 .

[3]  A. Pilnick,et al.  Qualitative research in nutrition and dietetics: assessing quality. , 2011, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[4]  The origins of the SPAR-H method’s performance shaping factor multipliers , 2007, 2007 IEEE 8th Human Factors and Power Plants and HPRCT 13th Annual Meeting.

[5]  Adam Lindgreen,et al.  What makes a good case study? A positivist review of qualitative case research published in Industrial Marketing Management, 1971–2006 , 2010 .

[6]  John A. H. Lewis,et al.  Redefining Qualitative Methods: Believability in the Fifth Moment , 2009 .

[7]  J. Morse.  Critical Analysis of Strategies for Determining Rigor in Qualitative Inquiry , 2015, Qualitative health research.

[8]  Lucy Yardley,et al.  Demonstrating validity in qualitative psychology , 2007 .

[9]  H. Yusof,et al.  Quality in Qualitative Studies: The Case of Validity, Reliability and Generalizability , 2011 .

[10]  M. Johnson,et al.  Rigour, reliability and validity in qualitative research , 2000 .

[11]  M. Patton.  Qualitative research & evaluation methods , 2002 .

[12]  M. Angen.  Evaluating Interpretive Inquiry: Reviewing the Validity Debate and Opening the Dialogue , 2000, Qualitative health research.

[13]  E. Guba,et al.  Fourth Generation Evaluation , 1989 .

[14]  Linda Amankwaa,et al.  CREATING PROTOCOLS FOR TRUSTWORTHINESS IN QUALITATIVE RESEARCH. , 2016, Journal of cultural diversity.

[15]  Robert T. Jiménez,et al.  Qualitative Studies in Special Education , 2005 .

[16]  Debbie Laliberte Rudman,et al.  Bridging Conceptions of Quality in Moments of Qualitative Research , 2013 .

[17]  Barry Kirwan,et al.  A Guide to Practical Human Reliability Assessment , 1994 .

[18]  K. Malterud.  Qualitative research: standards, challenges, and guidelines , 2001, The Lancet.

[19]  Bridget C. O’Brien,et al.  Standards for Reporting Qualitative Research: A Synthesis of Recommendations , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[20]  Alan D. Swain,et al.  Human reliability analysis: Need, status, trends and limitations , 1990 .

[21]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[22]  N. King.  Doing Template Analysis , 2012 .

[23]  Gabriel Cepeda,et al.  A review of case studies publishing in Management Decision 2003‐2004 , 2005 .

[24]  A. Barusch,et al.  Rigor in Qualitative Social Work Research: A Review of Strategies Used in Published Articles , 2011 .

[25]  J. Meyrick.  What is Good Qualitative Research? , 2006, Journal of health psychology.

[26]  Barry Kirwan,et al.  A Guide To Task Analysis: The Task Analysis Working Group , 1992 .

[27]  N. King,et al.  The Utility of Template Analysis in Qualitative Psychology Research , 2014, Qualitative research in psychology.

[28]  L. Jack,et al.  Appraising Qualitative Research in Health Education: Guidelines for Public Health Educators , 2010, Health promotion practice.

[29]  Author and Reviewer Guideline Series: Reporting Qualitative Studies , 2000 .

[30]  L. Yardley.  Dilemmas in qualitative health research , 2000 .

[31]  D. Cohen,et al.  Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations , 2008, The Annals of Family Medicine.

[32]  G. Andrews,et al.  Mja Guidelines for Assessing Qualitative Research Quality in Qualitative Research Criteria for Authors and Assessors in the Submission and Assessment of Qualitative Research Articles for the Medical Journal of Australia , 2022 .

[33]  Andreas M Riege,et al.  Validity and reliability tests in case study research: a literature review with “hands‐on” applications for each research phase , 2003 .

[34]  Huafei Liao.  Lessons Learned from the US HRA Empirical Study. , 2014 .

[35]  Chad Perry,et al.  Research design and data analysis in realism research , 2006 .

[36]  Lorelei Lingard,et al.  Critically appraising qualitative research , 2008, BMJ : British Medical Journal.

[37]  D. Goodwin,et al.  Gauging the quality of qualitative research in adapted physical activity. , 2014, Adapted physical activity quarterly : APAQ.

[38]  William B. Kline,et al.  Developing and Submitting Credible Qualitative Manuscripts , 2008 .

[39]  E. Guba,et al.  Competing paradigms in qualitative research. , 1994 .

[40]  K. Ryan-Nicholls,et al.  Rigour in qualitative research: mechanisms for control. , 2009, Nurse researcher.

[41]  H. Levitt,et al.  Recommendations for Designing and Reviewing Qualitative Research in Psychology: Promoting Methodological Integrity , 2017 .

[42]  N. King,et al.  Qualitative psychology in the real world: The utility of template analysis , 2012 .

[43]  P. Sainsbury,et al.  Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[44]  G. Rolfe.  Validity, trustworthiness and rigour: quality and the idea of qualitative research. , 2006, Journal of advanced nursing.

[45]  Susan L. Morrow.  Quality and trustworthiness in qualitative research in counseling psychology. , 2005 .

[46]  Susan L. Morrow,et al.  Achieving trustworthiness in qualitative research: A pan-paradigmatic perspective , 2009, Psychotherapy research : journal of the Society for Psychotherapy Research.

[47]  J. Anastas.  Quality in Qualitative Evaluation: Issues and Possible Answers , 2004 .