Designing and evaluating an electronic patient falls reporting system: Perspectives for the implementation of health information technology in long-term residential care facilities

BACKGROUND AND PURPOSE Patient falls are the leading cause of unintentional injury and death among older adults. In 2000, falls resulted in over 10,300 elderly deaths, costing the United States approximately $179 million in incidence and medical costs. Furthermore, non-fatal injuries caused by falls cost the United States $19 billion annually. Health information technology (IT) applications, specifically electronic falls reporting systems, can aid quality improvement efforts to prevent patient falls. Yet, long-term residential care facilities (LTRCFs) often do not have the financial resources to implement health IT, and workers in these settings are often not ready to adopt such systems. Additionally, most health IT evaluations are conducted in large acute-care settings, so LTRCF administrators currently lack evidence to support the value of health IT. METHODS In this paper, we detail the development of a novel, easy-to-use system to facilitate electronic patient falls reporting within a LTRCF using off-the-shelf technology that can be inexpensively implemented in a wide variety of settings. We report the results of four complimentary system evaluation measures that take into consideration varied organizational stakeholders' perspectives: (1) System-level benefits and costs, (2) system usability, via scenario-based use cases, (3) a holistic assessment of users' physical, cognitive, and marcoergonomic (work system) challenges in using the system, and (4) user technology acceptance. We report the viability of collecting and analyzing data specific to each evaluation measure and detail the relative merits of each measure in judging whether the system is acceptable to each stakeholder. RESULTS AND CONCLUSIONS The electronic falls reporting system was successfully implemented, with 100% reporting at 3-months post-implementation. The system-level benefits and costs approach showed that the electronic system required no initial investment costs aside from personnel costs and significant benefits accrued from user time savings. The usability analysis revealed several fixable design flaws and demonstrated the importance of scenario-based user training. The technology acceptance model showed that users perceived the reporting system to be useful and easy to use, even more so after implementation. Finally, the holistic human factors evaluation identified challenges encountered when nurses used the system as a part of their daily work, guiding further system redesign. The four-pronged evaluation framework accounted for varied stakeholder perspectives and goals and is a highly scalable framework that can be easily applied to health IT implementations in other LTRCFs.

[1]  H. Tzeng,et al.  Nurses' solutions to prevent inpatient falls in hospital patient rooms. , 2008, Nursing economic$.

[2]  D. Bates.  Physicians and ambulatory electronic health records. , 2005, Health affairs.

[3]  John Doucette,et al.  Adopting electronic medical records in primary care: Lessons learned from health information systems implementation experience in seven countries , 2009, Int. J. Medical Informatics.

[4]  David W. Bates,et al.  Information technology and patient safety in nursing practice: an international perspective , 2004, International Journal of Medical Informatics.

[5]  Jenna L. Marquard,et al.  Scenario-based User Testing to Guide Consumer Health Informatics Design , 2009, AMIA.

[6]  A Holistic Human Factors Evaluation Framework for the Design of Consumer Health Informatics Interventions , 2009 .

[7]  Elske Ammenwerth,et al.  Evaluation of health information systems - problems and challenges , 2003, Int. J. Medical Informatics.

[8]  T. Bodenheimer.  Coordinating care--a perilous journey through the health care system. , 2008, The New England journal of medicine.

[9]  Lorraine Nicholson,et al.  Evaluating large scale health information systems: from practice towards theory , 1997, AMIA.

[10]  Helaine E. Resnick,et al.  Research Paper: Use of Electronic Information Systems in Nursing Homes: United States, 2004 , 2009, J. Am. Medical Informatics Assoc..

[11]  Ping Yu,et al.  Health IT acceptance factors in long-term care facilities: A cross-sectional survey , 2009, Int. J. Medical Informatics.

[12]  Vimla L. Patel,et al.  Cognitive evaluation of decision making processes and assessment of information technology in medicine , 1998, Int. J. Medical Informatics.

[13]  Anne F. Kittler,et al.  A cost-benefit analysis of electronic medical records in primary care. , 2003, The American journal of medicine.

[14]  K Moore,et al.  Implementation of the ANA report card. , 1999, The Journal of nursing administration.

[15]  Sowmya R. Rao,et al.  Electronic health records in ambulatory care--a national survey of physicians. , 2008, The New England journal of medicine.

[16]  Robert A Berenson,et al.  Lost in Transition: Challenges and Opportunities for Improving the Quality of Transitional Care , 2004, Annals of Internal Medicine.

[17]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[18]  E. Finkelstein,et al.  The costs of fatal and non-fatal falls among older adults , 2006, Injury Prevention.

[19]  Prodromos D. Chatzoglou,et al.  Using a modified technology acceptance model in hospitals , 2009, Int. J. Medical Informatics.

[20]  Michael Rigby,et al.  Evaluation: 16 Powerful Reasons Why Not to Do It - And 6 Over-Riding Imperatives , 2001, MedInfo.

[21]  Charles Safran,et al.  Informatics as a Strategy for Reducing Health Disparities in Underserved Populations , 2004 .