Measuring the Reliability of Qualitative Text Analysis Data

This paper reports a new tool for assessing thereliability of text interpretationsheretofore unavailable to qualitative research.It responds to a combination of twochallenges, the problem of assessing the reliabilityof multiple interpretations – asolution to this problem was anticipated earlier(Krippendorff, 1992) but not fullydeveloped – and the problem of identifying unitsof analysis within a continuum of textand similar representations (Krippendorff, 1995).The paper sketches the family ofα-coefficients, which this paper extends, andthen describes its new arrival.A computational example is included in the Appendix.

[1]  K. Krippendorff.  Bivariate Agreement Coefficients for Reliability of Data , 1970 .

[2]  Klaus Krippendorff,et al.  On the Reliability of Unitizing Continuous Data , 1995 .

[3]  Klaus Krippendorff,et al.  Recent Developments in Reliability Analysis , 1992 .

[4]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[5]  W. A. Scott,et al.  Reliability of Content Analysis ; The Case of Nominal Scale Cording , 1955 .

[6]  Klaus Krippendorff,et al.  Association, agreement, and equity , 1987 .

[7]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution. IX.—On the principle of homotyposis and its relation to heredity, to the variability of the individual, and to that of the race. Part I.—homotyposis in the vegetable kingdom , 1901, Proceedings of the Royal Society of London.

[8]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[9]  Robert L. Brennan,et al.  An Essay on the History and Future of Reliability from the Perspective of Replications , 2001 .

[10]  M. L. Tildesley.  A FIRST STUDY OF THE BURMESE SKULL , 1921 .

[11]  K. Krippendorff.  Krippendorff, Klaus, Content Analysis: An Introduction to its Methodology . Beverly Hills, CA: Sage, 1980. , 1980 .

[12]  Karl Pearson,et al.  Mathematical Contributions to the Theory of Evolution. IX. On the Principle of Homotyposis and Its Relation to Heredity, to the Variability of the Individual, and to that of the Race. Part I. Homotypos in the Vegetable Kingdom , 1901 .