University of Groningen External validation of two prediction models identifying employees at risk of high sickness

Background: Two models including age, self-rated health (SRH) and prior sickness absence (SA) were found to predict high SA in health care workers. The present study externally validated these prediction models in a population of office workers and investigated the effect of adding gender as a predictor. Methods: SRH was assessed at baseline in a convenience sample of office workers. Age, gender and prior SA were retrieved from an occupational health service register. Two pre-defined prediction models were externally validated: a model identifying employees with high (i.e. ≥30) SA days and a model identifying employees with high (i.e. ≥3) SA episodes during 1-year follow-up. Calibration was investigated by plotting the predicted and observed probabilities and calculating the calibration slope. Discrimination was examined by receiver operating characteristic (ROC) analysis and the area under the ROC-curve (AUC). Results: A total of 593 office workers had complete data and were eligible for analysis. Although the SA days model showed acceptable calibration (slope = 0.89), it poorly discriminated office workers with high SA days from those without high SA days (AUC = 0.65; 95% CI 0.58–0.71). The SA episodes model showed acceptable discrimination (AUC = 0.76, 95% CI 0.70–0.82) and calibration (slope = 0.96). The prognostic performance of the prediction models did not improve in the population of office workers after adding gender. Conclusion: The SA episodes model accurately predicted the risk of high SA episodes in office workers, but needs further multisite validation and requires a simpler presentation format before it can be used to select high-risk employees for interventions to prevent or reduce SA.

[1]  K. Khaw,et al.  What determines Self-Rated Health (SRH)? A cross-sectional study of SF-36 health domains in the EPIC-Norfolk cohort , 2010, Journal of Epidemiology & Community Health.

[2]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[3]  C. Rutte,et al.  Sickness absence: A gender-focused review , 2009, Psychology, health & medicine.

[4]  N. Jansen,et al.  Screening questionnaire Balansmeter proved successful in predicting future long-term sickness absence in office workers. , 2009, Journal of clinical epidemiology.

[5]  R. Wahlström,et al.  Sickness absence and self-reported health a population-based study of 43,600 individuals in central Sweden , 2008, BMC public health.

[6]  I. Kant,et al.  Psychometrics and validation of a screening instrument for sickness absence. , 2008, Occupational medicine.

[7]  I. Kant,et al.  Effectiveness of a Preventive Coaching Intervention for Employees at Risk for Sickness Absence Due to Psychosocial Health Complaints: Results of a Randomized Controlled Trial , 2008, Journal of occupational and environmental medicine.

[8]  J. Groothoff,et al.  Risk of future sickness absence in frequent and long-term absentees. , 2008, Occupational medicine.

[9]  N. Jansen,et al.  Structured Early Consultation with the Occupational Physician Reduces Sickness Absence Among Office Workers at High Risk for Long-Term Sickness Absence: a Randomized Controlled Trial , 2008, Journal of Occupational Rehabilitation.

[10]  J. Groothoff,et al.  Frequent and long-term absence as a risk factor for work disability and job termination among employees in the private sector , 2007, Occupational and Environmental Medicine.

[11]  H. Sintonen,et al.  An occupational health intervention programme for workers at high risk for sickness absence. Cost effectiveness analysis based on a randomised controlled trial , 2007, Occupational and Environmental Medicine.

[12]  H. Sintonen,et al.  The effectiveness of two occupational health intervention programmes in reducing sickness absence among employees at risk. Two randomised controlled trials , 2007, Occupational and Environmental Medicine.

[13]  M. Kivimäki,et al.  Using administrative sickness absence data as a marker of future disability pension: the prospective DREAM study of Danish private sector employees , 2007, Occupational and Environmental Medicine.

[14]  I. Kant,et al.  Advantages and disadvantages of an objective selection process for early intervention in employees at risk for sickness absence , 2007, BMC public health.

[15]  P. Norman,et al.  What is the association between sickness absence, mortality and morbidity? , 2006, Health & place.

[16]  J. Groothoff,et al.  Identifying workers at risk of sickness absence by questionnaire. , 2006, Occupational medicine.

[17]  I. Kant,et al.  Prediction of sickness absence: development of a screening instrument , 2006, Occupational and Environmental Medicine.

[18]  M. Kivimäki,et al.  Sickness absence as a risk factor for job termination, unemployment, and disability pension among temporary and permanent employees , 2006, Occupational and Environmental Medicine.

[19]  Martina Mittlböck,et al.  Careful use of pseudo R‐squared measures in epidemiological studies , 2005, Statistics in medicine.

[20]  A. Bowling,et al.  Just One Question: If One Question Works, Why Ask Several? Single Compared with Multi- Item Measures , 2005 .

[21]  P. Allebeck,et al.  Chapter 5. Risk factors for sick leave - general studies , 2004, Scandinavian journal of public health. Supplement.

[22]  Ewout W Steyerberg,et al.  Validation and updating of predictive logistic regression models: a study on sample size and shrinkage , 2004, Statistics in medicine.

[23]  Michael A Babyak,et al.  What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type Models , 2004, Psychosomatic medicine.

[24]  D E Grobbee,et al.  External validation is necessary in prediction research: a clinical example. , 2003, Journal of clinical epidemiology.

[25]  M. Marmot,et al.  Sickness absence as a global measure of health: evidence from mortality in the Whitehall II prospective cohort study , 2003, BMJ : British Medical Journal.

[26]  R. D'Agostino,et al.  External validity of predictive models: a comparison of logistic regression, classification trees, and neural networks. , 2003, Journal of clinical epidemiology.

[27]  G H Guyatt,et al.  Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. , 2000, JAMA.

[28]  S. Melamed,et al.  Healthy volunteer effect in industrial workers. , 1999, Journal of clinical epidemiology.

[29]  K. Covinsky,et al.  Assessing the Generalizability of Prognostic Information , 1999, Annals of Internal Medicine.

[30]  T V Perneger,et al.  Analysis of non-response bias in a mailed health survey. , 1997, Journal of clinical epidemiology.

[31]  M Marmot,et al.  Sickness absence as a measure of health status and functioning: from the UK Whitehall II study. , 1995, Journal of epidemiology and community health.

[32]  Ming-Yueh Tarng,et al.  Conceptual Framework of Information for MIS , 1989 .

[33]  J. Knottnerus,et al.  Clinical prediction models are not being validated. , 2015, Journal of clinical epidemiology.

[34]  M. Labriola Conceptual framework of sickness absence and return to work, focusing on both the individual and the contextual level. , 2008, Work.

[35]  A. Worster,et al.  Understanding receiver operating characteristic (ROC) curves. , 2006, CJEM.