Measuring Agreement of Multivariate Discrete Survival Times Using a Modified Weighted Kappa Coefficient

Assessing agreement is often of interest in clinical studies to evaluate the similarity of measurements produced by different raters or methods on the same subjects. We present a modified weighted kappa coefficient to measure agreement between bivariate discrete survival times. The proposed kappa coefficient accommodates censoring by redistributing the mass of censored observations within the grid where the unobserved events may potentially happen. A generalized modified weighted kappa is proposed for multivariate discrete survival times. We estimate the modified kappa coefficients nonparametrically through a multivariate survival function estimator. The asymptotic properties of the kappa estimators are established and the performance of the estimators are examined through simulation studies of bivariate and trivariate survival times. We illustrate the application of the modified kappa coefficient in the presence of censored observations with data from a prostate cancer study.

[1]  H. Kraemer,et al.  Extension of the kappa coefficient. , 1980, Biometrics.

[2]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[3]  David R. Cox,et al.  A Note on Multiple Time Scales in Life Testing , 1979 .

[4]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[5]  T Duchesne,et al.  Alternative Time Scales and Failure Time Models , 2000, Lifetime data analysis.

[6]  Zhiliang Ying,et al.  A simple nonparametric estimator of the bivariate survival function under univariate censoring , 1993 .

[7]  Anthony F Jorm,et al.  Control-informant agreement on exposure history in case-control studies of Alzheimer's disease. , 1992, International journal of epidemiology.

[8]  Jacob Cohen,et al.  The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability , 1973 .

[9]  T. Allison,et al.  A New Procedure for Assessing Reliability of Scoring EEG Sleep Recordings , 1971 .

[10]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[11]  Wei-Yann Tsai,et al.  A note on nonparametric estimators of the bivariate survival function under univariate censoring , 1998 .

[12]  James D. Cox,et al.  Consensus statement: Guidelines for PSA following radiation therapy , 1997 .

[13]  Neil Klar,et al.  An Estimating Equations Approach for Modelling Kappa , 2000 .

[14]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[15]  W. Willett,et al.  Misinterpretation and misuse of the kappa statistic. , 1987, American journal of epidemiology.

[16]  K B Kordonsky,et al.  Multiple Time Scales and the Lifetime Coefficient of Variation: Engineering Applications , 1997, Lifetime data analysis.

[17]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[18]  A. Manatunga,et al.  Modeling the Agreement of Discrete Bivariate Survival Times using Kappa Coefficient , 2005, Lifetime data analysis.

[19]  Ying Guo,et al.  Nonparametric Estimation of the Concordance Correlation Coefficient under Univariate Censoring , 2007, Biometrics.

[20]  A K Manatunga,et al.  Modeling kappa for measuring dependent categorical agreement data. , 2000, Biostatistics.

[21]  V M Chinchilli,et al.  A generalized concordance correlation coefficient for continuous and categorical data , 2001, Statistics in medicine.

[22]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[23]  D. Oakes,et al.  Bivariate survival models induced by frailties , 1989 .

[24]  D. Hussey.  American Society for Therapeutic Radiology and Oncology , 2001 .

[25]  Laurence L. George,et al.  The Statistical Analysis of Failure Time Data , 2003, Technometrics.

[26]  Jianwen Cai,et al.  Covariance and survivor function estimation using censored multivariate failure time data , 1992 .

[27]  F. Critz,et al.  Prostate specific antigen‐monitored combination radiotherapy for patients with prostate cancer. I‐125 implant followed by external‐beam radiation , 1995, Cancer.

[28]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data: Kalbfleisch/The Statistical , 2002 .

[29]  Joanna H. Shih,et al.  Modeling multivariate discrete failure time data. , 1998, Biometrics.

[30]  D Oakes,et al.  Multiple time scales in survival analysis , 1995, Lifetime data analysis.

[31]  A. K. Levinson,et al.  Prostate-specific antigen nadir: the optimum level after irradiation for prostate cancer. , 1996, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[32]  D. Clayton.  A model for association in bivariate life tables and its application in epidemiological studies of familial tendency in chronic disease incidence , 1978 .