Developing a theoretical model and questionnaire survey instrument to measure the success of electronic health records in residential aged care

Electronic health records (EHR) are introduced into healthcare organizations worldwide to improve patient safety, healthcare quality and efficiency. A rigorous evaluation of this technology is important to reduce potential negative effects on patient and staff, to provide decision makers with accurate information for system improvement and to ensure return on investment. Therefore, this study develops a theoretical model and questionnaire survey instrument to assess the success of organizational EHR in routine use from the viewpoint of nursing staff in residential aged care homes. The proposed research model incorporates six variables in the reformulated DeLone and McLean information systems success model: system quality, information quality, service quality, use, user satisfaction and net benefits. Two variables training and self-efficacy were also incorporated into the model. A questionnaire survey instrument was designed to measure the eight variables in the model. After a pilot test, the measurement scale was used to collect data from 243 nursing staff members in 10 residential aged care homes belonging to three management groups in Australia. Partial least squares path modeling was conducted to validate the model. The validated EHR systems success model predicts the impact of the four antecedent variables—training, self-efficacy, system quality and information quality—on the net benefits, the indicator of EHR systems success, through the intermittent variables use and user satisfaction. A 24-item measurement scale was developed to quantitatively evaluate the performance of an EHR system. The parsimonious EHR systems success model and the measurement scale can be used to benchmark EHR systems success across organizations and units and over time.

[1]  R. Gooding,et al.  Effects of Societal Trends on Participation Research. , 1987 .

[2]  Judith A. Effken,et al.  Development and initial evaluation of the Clinical Information Systems Success Model (CISSM) , 2013, Int. J. Medical Informatics.

[3]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[4]  I. Ajzen,et al.  Attitude-behavior relations: A theoretical analysis and review of empirical research. , 1977 .

[5]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[6]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[7]  Peter B. Seddon,et al.  A Partial Test and Development of Delone and Mclean's Model of IS Success , 1996, Australas. J. Inf. Syst..

[8]  R. Baron,et al.  Electronic Health Records: Just around the Corner? Or over the Cliff? , 2005, Annals of Internal Medicine.

[9]  Peter B. Seddon,et al.  A Partial Test and Development of the DeLone and McLean Model of IS Success , 1994, ICIS.

[10]  Ping Yu,et al.  The impact of an electronic nursing documentation system on efficiency of documentation by caregivers in a residential aged care facility. , 2012, Journal of clinical nursing.

[11]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[12]  Bernadette Szajna,et al.  Empirical evaluation of the revised technology acceptance model , 1996 .

[13]  William J. Doll,et al.  Developing a multidimensional measure of system-use in an organizational context , 1998, Inf. Manag..

[14]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[15]  Narasimhaiah Gorla,et al.  Organizational impact of system quality, information quality, and service quality , 2010, J. Strateg. Inf. Syst..

[16]  D. Sandy Staples,et al.  Having expectations of information systems benefits that match received benefits: does it really matter? , 2002, Inf. Manag..

[17]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[18]  Magid Igbaria,et al.  Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model , 1997, MIS Q..

[19]  Claus Bossen,et al.  Evaluation of a comprehensive EHR based on the DeLone and McLean model for IS success: Approach, results, and success factors , 2013, Int. J. Medical Informatics.

[20]  Wynne W. Chin The partial least squares approach for structural equation modeling. , 1998 .

[21]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[22]  J. Merrill,et al.  An Information Systems Model of the Determinants of Electronic Health Record Use , 2013, Applied Clinical Informatics.

[23]  Ping Yu,et al.  Does the introduction of an electronic nursing documentation system in a nursing home reduce time on documentation for the nursing staff? , 2011, Int. J. Medical Informatics.

[24]  Ephraim R. McLean,et al.  A meta-analytic assessment of the DeLone and McLean IS success model: An examination of IS success at the individual level , 2009, Inf. Manag..

[25]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[26]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[27]  Stacie Petter,et al.  Evaluating the success of an emergency response medical information system , 2011, Int. J. Medical Informatics.

[28]  Neda Abasi,et al.  Information systems success: the quest for the dependent variable , 2015 .

[29]  Anol Bhattacherjee,et al.  Physicians' resistance toward healthcare information technology: a theoretical model and empirical test , 2007, Eur. J. Inf. Syst..

[30]  Maarten Gelderman,et al.  The relation between user satisfaction, usage of information systems and performance , 1998, Inf. Manag..

[31]  Ping Yu,et al.  Health IT acceptance factors in long-term care facilities: A cross-sectional survey , 2009, Int. J. Medical Informatics.

[32]  Tao Jiang,et al.  The Impact of Electronic Health Records on Risk Management of Information Systems in Australian Residential Aged Care Homes , 2016, Journal of Medical Systems.

[33]  Kathleen S. Hartzel How self-efficacy and gender issues affect software adoption and use , 2003, CACM.

[34]  Rajiv Kohli,et al.  Performance Impacts of Information Technology: Is Actual Usage the Missing Link? , 2003, Manag. Sci..

[35]  Karim Keshavjee,et al.  Applying methodology to electronic medical record selection , 2003, Int. J. Medical Informatics.

[36]  Ephraim R. McLean,et al.  Measuring information systems success: models, dimensions, measures, and interrelationships , 2008, Eur. J. Inf. Syst..

[37]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[38]  Eldon Y. Li Perceived importance of information system success factors: A meta analysis of group differences , 1997, Inf. Manag..

[39]  Rohan Jayasuriya,et al.  The roles of 'subjective computer training' and management support in the use of computers in community health centres. , 2004, Informatics in primary care.

[40]  J. Hair Multivariate data analysis : a global perspective , 2010 .

[41]  Ping Yu,et al.  A Review of Data Quality Assessment Methods for Public Health Information Systems , 2014, International journal of environmental research and public health.

[42]  G. Paré,et al.  Toward a multidimensional assessment of picture archiving and communication system success , 2005, International Journal of Technology Assessment in Health Care.

[43]  Paul Jen-Hwa Hu,et al.  Extending the two‐stage information systems continuance model: incorporating UTAUT predictors and the role of context , 2011, Inf. Syst. J..

[44]  Ping Yu,et al.  Unintended adverse consequences of introducing electronic health records in residential aged care homes , 2013, Int. J. Medical Informatics.

[45]  Theresa J. B. Kline The Groupware Adoption Scale: a measure of employee acceptance , 2001 .

[46]  Wynne W. Chin,et al.  Extending the technology acceptance model: the influence of perceived user resources , 2001, DATB.

[47]  Marie-Pierre Gagnon,et al.  Healthcare professional acceptance of telemonitoring for chronic care patients in primary care , 2012, BMC Medical Informatics and Decision Making.

[48]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[49]  Jen-Her Wu,et al.  An organizational memory information systems success model: an extension of DeLone and McLean's I/S success model , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[50]  Ping Yu,et al.  Caregivers' acceptance of electronic documentation in nursing homes , 2008, Journal of telemedicine and telecare.

[51]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[52]  George Ochieng Otieno,et al.  Measuring effectiveness of electronic medical records systems: Towards building a composite index for benchmarking hospitals , 2008, Int. J. Medical Informatics.

[53]  T Mairinger,et al.  Pathologists' attitudes to implementing telepathology , 1998, Journal of telemedicine and telecare.

[54]  Ping Yu,et al.  The benefits of introducing electronic health records in residential aged care facilities: A multiple case study , 2012, Int. J. Medical Informatics.

[55]  W O Hackl,et al.  “Why the Hell Do We Need Electronic Health Records?” , 2010, Methods of Information in Medicine.

[56]  Jing Li,et al.  Relationships among quality management, IS use and organizational performance in the health care and non-health care setting , 2002 .

[57]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[58]  Peter B. Seddon A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..