Variability and performance of NHS England’s ‘reason to reside’ criteria in predicting hospital discharge in acute hospitals in England: a retrospective, observational cohort study

Objectives NHS England (NHSE) advocates ‘reason to reside’ (R2R) criteria to support discharge planning. The proportion of patients without R2R and their rate of discharge are reported daily by acute hospitals in England. R2R has no interoperable standardised data model (SDM), and its performance has not been validated. We aimed to understand the degree of intercentre and intracentre variation in R2R-related metrics reported to NHSE, define an SDM implemented within a single centre Electronic Health Record to generate an electronic R2R (eR2R) and evaluate its performance in predicting subsequent discharge. Design Retrospective observational cohort study using routinely collected health data. Setting 122 NHS Trusts in England for national reporting and an acute hospital in England for local reporting. Participants 6 602 706 patient-days were analysed using 3-month national data and 1 039 592 patient-days, using 3-year single centre data. Main outcome measures Variability in R2R-related metrics reported to NHSE. Performance of eR2R in predicting discharge within 24 hours. Results There were high levels of intracentre and intercentre variability in R2R-related metrics (p<0.0001) but not in eR2R. Informedness of eR2R for discharge within 24 hours was low (J-statistic 0.09–0.12 across three consecutive years). In those remaining in hospital without eR2R, 61.2% met eR2R criteria on subsequent days (76% within 24 hours), most commonly due to increased NEWS2 (21.9%) or intravenous therapy administration (32.8%). Conclusions Reported R2R metrics are highly variable between and within acute Trusts in England. Although case-mix or community care provision may account for some variability, the absence of a SDM prevents standardised reporting. Following the development of a SDM in one acute Trust, the variability reduced. However, the performance of eR2R was poor, prone to change even when negative and unable to meaningfully contribute to discharge planning.

[1]  M. Ghassemi,et al.  The medical algorithmic audit. , 2022, The Lancet. Digital health.

[2]  E. Sapey,et al.  Evaluation of NEWS2 response thresholds in a retrospective observational study from a UK acute hospital , 2022, BMJ Open.

[3]  E. Sapey,et al.  Applying a COVID Virtual Ward model, assessing patient outcomes and staff workload. , 2021, Acute medicine.

[4]  G. Gkoutos,et al.  Infrastructure and operating processes of PIONEER, the HDR-UK Data Hub in Acute Care and the workings of the Data Trust Committee: a protocol paper , 2021, BMJ Health & Care Informatics.

[5]  A. Rafferty,et al.  Models of generalist and specialist care in smaller hospitals in England: a mixed-methods study , 2021 .

[6]  Sara Graziadio,et al.  Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard – An update , 2019, PloS one.

[7]  R. Romero-Ortuño,et al.  Change in skeletal muscle associated with unplanned hospital admissions in adult patients: A systematic review and meta-analysis , 2019, PloS one.

[8]  N. Peel,et al.  Hospital‐Associated Complications of Older People: A Proposed Multicomponent Outcome for Acute Care , 2018, Journal of the American Geriatrics Society.

[9]  P. Verhaak,et al.  Prevalence, presentation and prognosis of delirium in older people in the population, at home and in long term care: a review , 2013, International journal of geriatric psychiatry.

[10]  Enrique F Schisterman,et al.  Youden Index and the optimal threshold for markers with mass at zero , 2008, Statistics in medicine.

[11]  P. Bossuyt,et al.  Evaluation of diagnostic tests when there is no gold standard. A review of methods. , 2007, Health technology assessment.

[12]  J Hilden,et al.  Regret graphs, diagnostic uncertainty and Youden's Index. , 1996, Statistics in medicine.

[13]  John-Paul Taylor,et al.  The Diagnosis of Delirium Superimposed on Dementia: An Emerging Challenge. , 2017, Journal of the American Medical Directors Association.

[14]  John Purcell,et al.  Report of the Comptroller and Auditor General , 2003 .

[15]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.