Combining regression trees and panel regression for exploring and testing the impact of complementary management practices on short-notice elective operation cancellation rates

ABSTRACT Variation in the performance of providers across healthcare systems is pervasive. It is recognised as both a major concern and an opportunity for learning and improvement. Variation between providers is broadly considered to be due to management practices and contextual factors such as catchment-area demographics. However, there is little understanding of the ways in which these impact on performance and how they can be measured. We use recent developments in both regression trees and panel regression techniques to explore and then statistically test complementary alignments of management practices whilst taking into account contextual factors. We apply this to 5 years of NHS hospital trust data, examining performance on short-notice cancellation rates. We find that different alignments of management practices give rise to quite different short-notice cancellation rates between trusts, with some being substantially lower. Our research offers a data-driven approach for identifying optimal clusters of management practices.

[1]  M. Mansur,et al.  Hospital heterogeneity: what drives the quality of health care , 2017, The European Journal of Health Economics.

[2]  Paul Milgrom,et al.  Complementarities and fit strategy, structure, and organizational change in manufacturing , 1995 .

[3]  Casey Ichniowski,et al.  The Effects of Human Resource Management Practices on Productivity , 1995 .

[4]  S. Rymaruk A Retrospective Observational Study of Patient Cancellations on the Day of Surgery in the General Surgical Directorate , 2011, Journal of perioperative practice.

[5]  Erik Brynjolfsson,et al.  Complementarity in Organizations , 2012 .

[6]  Andrew Street,et al.  Examining variations in hospital productivity in the English NHS , 2014, The European Journal of Health Economics.

[7]  N C Proudlove,et al.  Can good bed management solve the overcrowding in accident and emergency departments? , 2003, Emergency medicine journal : EMJ.

[8]  B. Steijn,et al.  Does Leadership Style Make a Difference? Linking HRM, Job Satisfaction, and Organizational Performance , 2014 .

[9]  M. Hawn,et al.  Elective surgical case cancellation in the Veterans Health Administration system: identifying areas for improvement. , 2009, American journal of surgery.

[10]  Markus Pannenberg,et al.  Trade Union Membership and Dismissals , 2010, SSRN Electronic Journal.

[11]  J. Pollard,et al.  Early outpatient preoperative anesthesia assessment: does it help to reduce operating room cancellations? , 1999, Anesthesia and analgesia.

[12]  Chris W. Clegg,et al.  THE IMPACT OF HUMAN RESOURCE AND OPERATIONAL MANAGEMENT PRACTICES ON COMPANY PRODUCTIVITY: A LONGITUDINAL STUDY , 2008 .

[13]  P. Dimitriadis,et al.  The challenge of cancellations on the day of surgery. , 2013, International journal of surgery.

[14]  A configurational approach to the relationship between high-performance work practices and frontline health care worker outcomes. , 2012, Health services research.

[15]  Kieran Walshe,et al.  The signal in the noise: Robust detection of performance “outliers” in health services , 2018, J. Oper. Res. Soc..

[16]  Cheng Soon Ong,et al.  Cancelled operations: a 7‐day cohort study of planned adult inpatient surgery in 245 UK National Health Service hospitals , 2018, British journal of anaesthesia.

[17]  D. Sindhusake,et al.  Cancellation of operations on the day of intended surgery at a major Australian referral hospital , 2005, The Medical journal of Australia.

[18]  Max Kuhn,et al.  Applied Predictive Modeling , 2013 .

[19]  Y. Mundlak On the Pooling of Time Series and Cross Section Data , 1978 .

[20]  John Asker,et al.  Corporate Investment and Stock Market Listing: A Puzzle? , 2013 .

[21]  Martin Bauer,et al.  The Effect of Hospital Size and Surgical Service on Case Cancellation in Elective Surgery: Results from a Prospective Multicenter Study , 2011, Anesthesia and analgesia.

[22]  R. Hand,et al.  The Causes of Cancelled Elective Surgery , 1990, Quality assurance and utilization review : official journal of the American College of Utilization Review Physicians.

[23]  G. Chamberlain Multivariate regression models for panel data , 1982 .

[24]  Ring-fencing — bed protection for the patient , 2005 .

[25]  R. Pinder,et al.  Staff perceptions of quality of care: an observational study of the NHS Staff Survey in hospitals in England , 2013, BMJ quality & safety.

[26]  Cancelled Procedures in the English NHS: Evidence from the 2010 Tariff Reform , 2017, Health economics.

[27]  J. Evans,et al.  Cancelled elective surgery: an evaluation. , 1994, The American surgeon.

[28]  John Ladbrook,et al.  Knowledge-based improvement: simulation and artificial intelligence for identifying and improving human decision-making in an operations system , 2005, J. Oper. Res. Soc..

[29]  Oddbjørn Bukve,et al.  Patient experiences with interventions to reduce surgery cancellations: a qualitative study , 2013, BMC Surgery.

[30]  K. Walshe,et al.  Investigating consistent patterns of variation in short-notice cancellations of elective operations: The potential for learning and improvement through multi-site evaluations , 2018, Health services management research.

[31]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[32]  Manhal Ali,et al.  Hospital productivity: The role of efficiency drivers. , 2019, The International journal of health planning and management.

[33]  Paul Milgrom,et al.  The Firm as an Incentive System , 1994 .

[34]  R. Schroeder,et al.  The impact of human resource management practices on operational performance: recognizing country and industry differences , 2003 .

[35]  Warren S. Sandberg,et al.  Causes of Cancellations on the Day of Surgery at Two Major University Hospitals , 2009, Surgical innovation.

[36]  Jeffrey S. Simonoff,et al.  Unbiased Regression Trees for Longitudinal and Clustered Data , 2014, Comput. Stat. Data Anal..

[37]  Heather C Kaplan,et al.  The influence of context on quality improvement success in health care: a systematic review of the literature. , 2010, The Milbank quarterly.

[38]  Gill Harvey,et al.  Analysing organisational context: case studies on the contribution of absorptive capacity theory to understanding inter-organisational variation in performance improvement , 2014, BMJ quality & safety.

[39]  Marc D Basson,et al.  Predicting Patient Nonappearance for Surgery as a Scheduling Strategy to Optimize Operating Room Utilization in a Veterans' Administration Hospital , 2006, Anesthesiology.

[40]  B. Mcintosh,et al.  Cancelled Surgeries and Payment by Results in the English National Health Service , 2012, Journal of health services research & policy.

[41]  Peter Spurgeon,et al.  Is management essential to improving the performance and sustainability of health care systems and organizations? A systematic review and a roadmap for future studies. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[42]  Paul Robert Harper,et al.  Modelling for the planning and management of bed capacities in hospitals , 2002, J. Oper. Res. Soc..

[43]  K. Hornik,et al.  Unbiased Recursive Partitioning: A Conditional Inference Framework , 2006 .

[44]  A. Woodward,et al.  Cancelled elective operations: an observational study from a district general hospital. , 2007, Journal of health organization and management.

[45]  Stephan Seiler,et al.  The Impact of Competition on Management Quality: Evidence from Public Hospitals , 2010 .

[46]  J. Forth,et al.  Does employees’ subjective well-being affect workplace performance? , 2017 .

[47]  John Van Reenen,et al.  The New Empirical Economics of Management , 2014 .

[48]  N. Bloom,et al.  Does Management Matter in Schools? , 2014, SSRN Electronic Journal.

[49]  Jeffrey S. Simonoff,et al.  RE-EM trees: a data mining approach for longitudinal and clustered data , 2011, Machine Learning.

[50]  T. Walsh,et al.  Impact of emergency admissions on elective surgical workload , 2004, Irish journal of medical science.

[51]  R. Agha,et al.  Cancellations in day-case ENT surgery , 2005 .

[52]  Heather Rosen,et al.  Case cancellations on the day of surgery: an investigation in an Australian paediatric hospital , 2009, ANZ journal of surgery.

[53]  Cancelled procedures: inequality, inequity and the National Health Service reforms. , 2013, Health economics.

[54]  J. Dawson,et al.  Reducing patient mortality in hospitals: the role of human resource management , 2006 .

[55]  Sylvia Larsson,et al.  Postponed or cancelled heart operations from the patient's perspective. , 2004, Journal of nursing management.

[56]  Karolina J. Glowacka,et al.  A hybrid data mining/simulation approach for modelling outpatient no-shows in clinic scheduling , 2009, J. Oper. Res. Soc..

[57]  R. Mollan,et al.  Total joint replacement: implication of cancelled operations for hospital costs and waiting list management. , 1992, Quality in health care : QHC.

[58]  J. Pandit,et al.  Day of surgery cancellations after nurse‐led pre‐assessment in an elective surgical centre: the first 2 years , 2003, Anaesthesia.

[59]  Yu-Li Huang,et al.  Radiology scheduling with consideration of patient characteristics to improve patient access to care and medical resource utilization , 2013 .

[60]  J. Morgan,et al.  Problems in the Analysis of Survey Data, and a Proposal , 1963 .

[61]  Sylvia Larsson,et al.  Patient reactions to cancelled or postponed heart operations. , 2002, Journal of nursing management.

[62]  Howard B. Gutstein,et al.  Cancellation of pediatric outpatient surgery: Economic and emotional implications for patients and their families , 1997 .

[63]  A. Chandra,et al.  Productivity Dispersion in Medicine and Manufacturing. , 2016, The American Economic Review.