A literature review for large-scale health information system project planning, implementation and evaluation

Information technology is perceived as a potential panacea for healthcare organisations to manage pressure to improve services in the face of increased demand. However, the implementation and evaluation of health information systems (HIS) is plagued with problems and implementation shortcomings and failures are rife. HIS implementation is complex and relies on organisational, structural, technological, and human factors to be successful. It also requires reflective, nuanced, multidimensional evaluation to provide ongoing feedback to ensure success. This article provides a comprehensive review of the literature about evaluating and implementing HIS, detailing the challenges and recommendations for both evaluators and healthcare organisations. The factors that inhibit or promote successful HIS implementation are identified and effective evaluation strategies are described with the goal of informing teams evaluating complex HIS.

[1]  Suzanne Rivard,et al.  Information Technology Implementers' Responses to User Resistance: Nature and Effects , 2012, MIS Q..

[2]  Joseph Restuccia,et al.  Hospital implementation of health information technology and quality of care: are they related? , 2012, BMC Medical Informatics and Decision Making.

[3]  Peter M Yellowlees,et al.  Successfully developing a telemedicine system. , 2005, Journal of telemedicine and telecare.

[4]  M. Harrison,et al.  Building capacity for a transformation initiative: system redesign at Denver Health. , 2009, Health care management review.

[5]  Kouhei Akazawa,et al.  Profit and loss analysis for an intensive care unit (ICU) in Japan: a tool for strategic management , 2006, BMC Health Services Research.

[6]  Heather C Kaplan,et al.  The influence of context on quality improvement success in health care: a systematic review of the literature. , 2010, The Milbank quarterly.

[7]  D. Brailer Interoperability: the key to the future health care system. , 2005, Health affairs.

[8]  Thomas R Campion,et al.  Peers, regulators, and professions: the influence of organizations in health information technology adoption. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[9]  Jane M. Brokel,et al.  Redesigning care processes using an electronic health record: a system's experience. , 2009, Joint Commission journal on quality and patient safety.

[10]  Patrick Waterson,et al.  Special issue on human factors and the implementation of health information technology (HIT): Comparing approaches across nations , 2013, Int. J. Medical Informatics.

[11]  C. May A rational model for assessing and evaluating complex interventions in health care , 2006, BMC Health Services Research.

[12]  Andrew Georgiou,et al.  An empirically-derived approach for investigating Health Information Technology: the Elementally Entangled Organisational Communication (EEOC) framework , 2012, BMC Medical Informatics and Decision Making.

[13]  J. Kahan,et al.  What Is eHealth (4): A Scoping Exercise to Map the Field , 2005, Journal of medical Internet research.

[14]  C. W. Johnson,et al.  Why did that happen? Exploring the proliferation of barely usable software in healthcare systems , 2006, Quality and Safety in Health Care.

[15]  Reinhold Haux,et al.  Health information systems - past, present, future , 2006, Int. J. Medical Informatics.

[16]  Nicol Nijland,et al.  A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies , 2011, Journal of medical Internet research.

[17]  M. Whittaker,et al.  Understanding the role of technology in health information systems. , 2012, Pacific health dialog.

[18]  David W. Bates,et al.  Case Report: The Use of Computers for Clinical Care: A Case Series of Advanced U.S. Sites , 2003, J. Am. Medical Informatics Assoc..

[19]  Iris A. Junglas,et al.  From cacophony to harmony: A case study about the IS implementation process as an opportunity for organizational transformation at Sentara Healthcare , 2011, J. Strateg. Inf. Syst..

[20]  D. Blumenthal,et al.  The benefits of health information technology: a review of the recent literature shows predominantly positive results. , 2011, Health affairs.

[21]  R Thomas,et al.  Information management and technology in England's large acute NHS hospitals. National strategy versus local reality. , 1995, Journal of management in medicine.

[22]  G. Eysenbach What is e-health? , 2001, Journal of Medical Internet Research.

[23]  David E. Avison,et al.  Time to rethink health care and ICT? , 2007, CACM.

[24]  Antoine Geissbuhler,et al.  Lessons learned implementing a regional health information exchange in Geneva as a pilot for the Swiss national eHealth strategy. , 2013, International journal of medical informatics.

[25]  Joseph L. Kannry,et al.  Emerging Approaches to Usability Evaluation of Health Information Systems: Towards In-Situ Analysis of Complex Healthcare Systems and Environments , 2011, MIE.

[26]  Lars Mathiassen,et al.  Contextual dynamics during health information systems implementation: an event-based actor-network approach , 2008, Eur. J. Inf. Syst..

[27]  Margaret McCartney Show us the evidence for telehealth , 2012, BMJ : British Medical Journal.

[28]  Carl May,et al.  Agency and implementation: understanding the embedding of healthcare innovations in practice. , 2013, Social science & medicine.

[29]  Robin Gauld,et al.  Dangerous Enthusiasms: E-government, Computer Failure and Information System Development , 2006 .

[30]  Meghan Hufstader Gabriel,et al.  Progress and challenges: implementation and use of health information technology among critical-access hospitals. , 2014, Health affairs.

[31]  Joan S. Ash,et al.  The unintended consequences of computerized provider order entry: Findings from a mixed methods exploration , 2009, Int. J. Medical Informatics.

[32]  Izak Benbasat,et al.  Outsourcing projects success: the role of competence and leadership of the vendors and clients project managers , 2010, SIGMIS-CPR '10.

[33]  Colin Ashurst,et al.  Factors affecting the successful realisation of benefits from systems development projects: findings from three case studies , 2012, J. Inf. Technol..

[34]  M. Jaana,et al.  Prioritizing the Risk Factors Influencing the Success of Clinical Information System Projects , 2008, Methods of Information in Medicine.

[35]  Bonnie Kaplan,et al.  Evaluating informatics applications - some alternative approaches: theory, social interactionism, and call for methodological pluralism , 2001, Int. J. Medical Informatics.

[36]  Zahra Meidani,et al.  Hospital Information Systems User Needs Analysis: A Vendor Survey , 2011 .

[37]  C. Dowrick,et al.  Complex interventions , 2022, International Review of Sport and Exercise Psychology.

[38]  W. Hersh,et al.  Health care information technology: progress and barriers. , 2004, JAMA.

[39]  Richard Heeks,et al.  Health information systems: Failure, success and improvisation , 2006, Int. J. Medical Informatics.

[40]  Patrick Waterson,et al.  Health information technology and sociotechnical systems: a progress report on recent developments within the UK National Health Service (NHS). , 2014, Applied ergonomics.

[41]  Paul N. Gorman,et al.  Barriers and facilitators to exchanging health information: a systematic review , 2016, Int. J. Medical Informatics.

[42]  Nicolette de Keizer,et al.  Guideline for good evaluation practice in health informatics (GEP-HI) , 2011, Int. J. Medical Informatics.

[43]  V. Mbarika,et al.  What is telemedicine? A collection of 104 peer-reviewed perspectives and theoretical underpinnings. , 2007, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[44]  Bonnie Kaplan,et al.  White Paper: Health IT Success and Failure: Recommendations from Literature and an AMIA Workshop , 2009, J. Am. Medical Informatics Assoc..

[45]  T. Paulussen,et al.  Determinants of innovation within health care organizations: literature review and Delphi study. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[46]  Elske Ammenwerth,et al.  Evaluation of health information systems - problems and challenges , 2003, Int. J. Medical Informatics.

[47]  C. AbouZahr,et al.  Health information systems: the foundations of public health. , 2005, Bulletin of the World Health Organization.

[48]  E. Keeler,et al.  Costs and benefits of health information technology. , 2006, Evidence report/technology assessment.

[49]  Mark White,et al.  Leadership, a key element of quality improvement in healthcare. Results from a literature review of “Lean Healthcare” and the Productive Ward , 2013 .

[50]  James Wallace,et al.  Clinical outcomes resulting from telemedicine interventions: a systematic review , 2001, BMC Medical Informatics Decis. Mak..

[51]  A. Sheikh,et al.  The Impact of Telehealthcare on the Quality and Safety of Care: A Systematic Overview , 2013, PloS one.

[52]  Thurasamy Ramayah,et al.  External Factors in Hospital Information System (HIS) Adoption Model: A Case on Malaysia , 2012, Journal of Medical Systems.

[53]  Gail Powell-Cope,et al.  Patient Care Technology and Safety , 2008 .

[54]  David W. Bates,et al.  The use of health information technology in seven nations , 2008, Int. J. Medical Informatics.

[55]  Tor Guimaraes,et al.  Testing some major determinants for hospital innovation success. , 2009, International journal of health care quality assurance.

[56]  Aziz Sheikh,et al.  Understanding the impact of information technology on interactions between patients and healthcare professionals: the INTERACT-IT study , 2012 .

[57]  Michael I. Harrison,et al.  Viewpoint Paper: Unintended Consequences of Information Technologies in Health Care - An Interactive Sociotechnical Analysis , 2007, J. Am. Medical Informatics Assoc..

[58]  W. Yasnoff,et al.  Public Health Informatics and Information Systems , 2003, Health Informatics.

[59]  Antoinette de Bont,et al.  Telemedicine in interdisciplinary work practices: On an IT system that met the criteria for success set out by its sponsors, yet failed to become part of every-day clinical routines , 2008, BMC Medical Informatics Decis. Mak..

[60]  Udechukwu Ojiako,et al.  Softer perspectives on enhancing the patient experience using IS/IT. , 2010, International journal of health care quality assurance.

[61]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[62]  T. Greenhalgh,et al.  Introduction of shared electronic records: multi-site case study using diffusion of innovation theory , 2008, BMJ : British Medical Journal.

[63]  Anastasia Papazafeiropoulou,et al.  An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit) , 2008, Int. J. Medical Informatics.

[64]  Margaret Meadors,et al.  Going Live , 2014 .

[65]  Jobke Wentzel,et al.  Designing eHealth that Matters via a Multidisciplinary Requirements Development Approach , 2013, JMIR research protocols.

[66]  R. G. Fichman,et al.  Editorial Overview---The Role of Information Systems in Healthcare: Current Research and Future Trends , 2011 .

[67]  Colleen Beecken Rye,et al.  The Adoption of Innovations by Provider Organizations in Health Care , 2007, Medical care research and review : MCRR.

[68]  Jeong-Whun Kim,et al.  Can a health information exchange save healthcare costs? Evidence from a pilot program in South Korea , 2015, Int. J. Medical Informatics.

[69]  Marc Berg,et al.  Implementing information systems in health care organizations: myths and challenges , 2001, Int. J. Medical Informatics.

[70]  Patrick Waterson,et al.  A critical review of the systems approach within patient safety research , 2009, Ergonomics.

[71]  Robin C. Meili,et al.  Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. , 2005, Health affairs.

[72]  Jan L. Talmon,et al.  The VATAM guidelines , 1999, Int. J. Medical Informatics.

[73]  Linda K Anderson,et al.  The "big bang" implementation: not for the faint of heart. , 2002, Computers in nursing.

[74]  Sunyoung Cho,et al.  A Contextualist Approach to Telehealth Innovations , 2007 .

[75]  N. A. D. Connell,et al.  Evaluating healthcare information systems through an "enterprise" perspective , 2007, Inf. Manag..

[76]  Johanna Kaipio,et al.  Quality of Health IT Evaluations. , 2016, Studies in health technology and informatics.

[77]  Gunnar Ellingsen,et al.  The organizing vision of integrated health information systems , 2008, Health Informatics J..

[78]  Joseph P. Wherton,et al.  The organising vision for telehealth and telecare: discourse analysis , 2012, BMJ Open.

[79]  Jane Hendy,et al.  Challenges to implementing the national programme for information technology (NPfIT): a qualitative study , 2005, BMJ : British Medical Journal.

[80]  Adrian Carr,et al.  Leadership for the systemization of health care: the unaddressed issue in health care reform , 2004 .

[81]  Farzad Mostashari,et al.  The Health IT Regional Extension Center Program: evolution and lessons for health care transformation. , 2014, Health services research.

[82]  J. Car,et al.  Telehealth for long term conditions , 2012, BMJ : British Medical Journal.

[83]  Charles Kenney,et al.  Transforming Health Care: Virginia Mason Medical Center's Pursuit of the Perfect Patient Experience , 2010 .

[84]  P. Plsek,et al.  The challenge of complexity in health care , 2001, BMJ : British Medical Journal.

[85]  A. Jha,et al.  Meaningful use of electronic health records: the road ahead. , 2010, JAMA.

[86]  Adrian Small,et al.  Doing transformational change in the English NHS in the context of "big bang" redisorganisation. , 2015, Journal of health organization and management.

[87]  Eric C. Pan,et al.  The value of health care information exchange and interoperability. , 2005, Health affairs.

[88]  J. Hendy,et al.  Effect of telehealth on use of secondary care and mortality: findings from the Whole System Demonstrator cluster randomised trial , 2012, BMJ : British Medical Journal.

[89]  Aziz Sheikh,et al.  Lessons learned from England's national electronic health record implementation: implications for the international community , 2012, IHI '12.

[90]  Marinos Themistocleous,et al.  How can user-centred design affect the acceptance and adoption of service oriented healthcare information systems? , 2012 .

[91]  Richard J. Holden,et al.  A theoretical model of health information technology usage behaviour with implications for patient safety , 2009, Behav. Inf. Technol..

[92]  Cameron James Stokes The Electronic Health Revolution: How Health Information Technology Is Changing Medicine - And the Obstacles in Its Way , 2012 .

[93]  Vivek Goel,et al.  The health care information directive , 2001, BMC Medical Informatics Decis. Mak..

[94]  Chris Sauer,et al.  Lessons from a failed information systems initiative: issues for complex organisations , 1999, Int. J. Medical Informatics.

[95]  Jeremy C. Wyatt,et al.  When and how to evaluate health information systems? , 2003, Int. J. Medical Informatics.

[96]  John Doucette,et al.  Adopting electronic medical records in primary care: Lessons learned from health information systems implementation experience in seven countries , 2009, Int. J. Medical Informatics.

[97]  Mona Mansour,et al.  Cincinnati Beacon Community Program highlights challenges and opportunities on the path to care transformation. , 2014, Health affairs.

[98]  A. Takian,et al.  Envisioning electronic health record systems as change management: the experience of an English hospital joining the National Programme for Information Technology. , 2012, Studies in health technology and informatics.

[99]  Robert M Wachter,et al.  Expected and unanticipated consequences of the quality and information technology revolutions. , 2006, JAMA.

[100]  M. Caudill-Slosberg,et al.  Case Study: Identifying Potential Problems at the Human/Technical Interface in Complex Clinical Systems , 2005, American journal of medical quality : the official journal of the American College of Medical Quality.

[101]  Gunnar Ellingsen,et al.  The Slight Surprise of Integration , 2005, Designing Ubiquitous Information Environments.

[102]  Trisha Greenhalgh,et al.  Achieving and sustaining profound institutional change in healthcare: case study using neo-institutional theory. , 2013, Social science & medicine.

[103]  M. J. Côté,et al.  Five Constants of Information Technology Adoption in Healthcare , 2007, Hospital topics.

[104]  Vimla L. Patel,et al.  Anticipating and addressing the unintended consequences of health IT and policy: a report from the AMIA 2009 Health Policy Meeting , 2011, J. Am. Medical Informatics Assoc..

[105]  Helen C Noel,et al.  Home telehealth reduces healthcare costs. , 2004, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[106]  Jeffrey S McCullough,et al.  The adoption of hospital information systems. , 2008, Health economics.

[107]  R. Wootton,et al.  Telemedicine, telehealth or e-health? A bibliometric analysis of the trends in the use of these terms , 2012, Journal of telemedicine and telecare.

[108]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[109]  Nancy M. Lorenzi,et al.  Organizational ISSUES=change , 2003, Int. J. Medical Informatics.

[110]  C. Hawn Take two aspirin and tweet me in the morning: how Twitter, Facebook, and other social media are reshaping health care. , 2009, Health affairs.

[111]  Lior Fink,et al.  Use patterns of health information exchange systems and admission decisions: Reductionistic and configurational approaches , 2015, Int. J. Medical Informatics.

[112]  Trisha Greenhalgh,et al.  Introducing a nationally shared electronic patient record: Case study comparison of Scotland, England, Wales and Northern Ireland , 2013, Int. J. Medical Informatics.

[113]  Ritu Agarwal,et al.  The Digitization of Healthcare: Boundary Risks, Emotion, and Consumer Willingness to Disclose Personal Health Information , 2011, Inf. Syst. Res..

[114]  T. L. Williams,et al.  Systematic review of cost effectiveness studies of telemedicine interventions , 2002, BMJ : British Medical Journal.

[115]  Steven R. Simon,et al.  Case Report: Community-wide Implementation of Health Information Technology: The Massachusetts eHealth Collaborative Experience , 2009, J. Am. Medical Informatics Assoc..

[116]  F. Mair,et al.  Why is it difficult to implement e-health initiatives? A qualitative study , 2011, Implementation science : IS.

[117]  Manolis Tsiknakis,et al.  An open, component-based information infrastructure for integrated health information networks , 2002, Int. J. Medical Informatics.

[118]  P. Ray,et al.  Health Care Provider Adoption of eHealth: Systematic Literature Review , 2013, Interactive journal of medical research.

[119]  J Roger Guard,et al.  Integrated advanced information management systems: a twenty-year history at the University of Cincinnati. , 2004, Journal of the Medical Library Association : JMLA.

[120]  H. Mistry Systematic review of studies of the cost-effectiveness of telemedicine and telecare. Changes in the economic evidence over twenty years , 2012, Journal of telemedicine and telecare.

[121]  Christina Smith,et al.  Perspectives From Nurse Leaders and Chief Information Officers on Health Information Technology Implementation , 2009, Hospital topics.

[122]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[123]  Andre Kushniruk,et al.  Integrating technology-centric and user-centric system testing methods: ensuring healthcare system usability and safety. , 2010, Studies in health technology and informatics.

[124]  M. Gagnon,et al.  Telehealth adoption in hospitals: an organisational perspective. , 2005, Journal of health organization and management.

[125]  James G. Anderson,et al.  Social, ethical and legal barriers to E-health , 2007, Int. J. Medical Informatics.

[126]  Elske Ammenwerth,et al.  BMC Medical Informatics and Decision Making , 2022 .

[127]  Nir Menachemi,et al.  Hospital IT Adoption Strategies Associated with Implementation Success: Implications for Achieving Meaningful Use , 2010, Journal of healthcare management / American College of Healthcare Executives.

[128]  Richard Herrmann,et al.  IGF-I induced genes in stromal fibroblasts predict the clinical outcome of breast and lung cancer patients , 2010, BMC medicine.

[129]  Patrick Powers E-health leads Nova Scotia's healthcare transformation. , 2009, Healthcare quarterly.

[130]  A. Sheikh,et al.  We are bitter, but we are better off: case study of the implementation of an electronic health record system into a mental health hospital in England , 2012, BMC Health Services Research.

[131]  T. Cornford,et al.  Qualitative evaluation of an electronic prescribing and administration system , 2007, Quality and Safety in Health Care.

[132]  Paul P. Maglio,et al.  Information technology for healthcare transformation , 2011, IBM J. Res. Dev..

[133]  Wendy L. Currie,et al.  The policy-practice nexus of electronic health records adoption in the UK NHS: An institutional analysis , 2011, J. Enterp. Inf. Manag..

[134]  David Shpilberg,et al.  Avoiding the Alignment Trap in IT , 2007 .

[135]  Richard J. Holden,et al.  The Technology Acceptance Model: Its past and its future in health care , 2010, J. Biomed. Informatics.

[136]  Jill Maben,et al.  Implementing large-scale quality improvement: lessons from The Productive Ward: Releasing Time to Care. , 2012, International journal of health care quality assurance.

[137]  Aziz Sheikh,et al.  Organizational issues in the implementation and adoption of health information technology innovations: An interpretative review , 2013, Int. J. Medical Informatics.

[138]  Mike Chiasson,et al.  Pushing the contextual envelope: developing and diffusing IS theory for health information systems research , 2004, Inf. Organ..

[139]  P Whitten,et al.  Results of a meta-analysis of cost–benefit research: Is this a question worth asking? , 2000, Journal of telemedicine and telecare.

[140]  Susan A. Sherer,et al.  Integrating commercial ambulatory electronic health records with hospital systems: An evolutionary process , 2015, Int. J. Medical Informatics.

[141]  Pierre Frémont,et al.  Systematic Review of Factors Influencing the Adoption of Information and Communication Technologies by Healthcare Professionals , 2012, Journal of Medical Systems.

[142]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[143]  Helen M. Edwards,et al.  Endless Bad Projects or Evidence-Based Practice? An Agenda for Action , 2013, TDIT.

[144]  J. Wyatt,et al.  Evaluating computerised health information systems: hard lessons still to be learnt , 2003, BMJ : British Medical Journal.

[145]  Jytte Brender Handbook of evaluation methods for health informatics , 2005 .

[146]  Julie Barnett,et al.  Understanding Innovation Deployment and Evaluation in Healthcare: The Triality Framework , 2012 .

[147]  D. Blumenthal,et al.  The "meaningful use" regulation for electronic health records. , 2010, The New England journal of medicine.

[148]  I. Sim,et al.  Physicians' use of electronic medical records: barriers and solutions. , 2004, Health affairs.

[149]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[150]  Alan Shiell,et al.  Complex interventions or complex systems? Implications for health economic evaluation , 2008, BMJ : British Medical Journal.

[151]  Liette Lapointe,et al.  The IT productivity paradox in health: A stakeholder's perspective , 2011, Int. J. Medical Informatics.

[152]  Anastasia Papazafeiropoulou,et al.  Investigating evaluation frameworks for health information systems , 2008, Int. J. Medical Informatics.

[153]  Craig E. Kuziemsky,et al.  A Complex Adaptive Systems Perspective of Health Information Technology Implementation , 2013, ITCH.

[154]  Nick Steen,et al.  Leadership and transformational change in healthcare organisations: A qualitative analysis of the North East Transformation System , 2013, Health Services Management Research.

[155]  Andrew C. Simpson,et al.  Collaboration and Trust in Healthcare Innovation: The eDiaMoND Case Study , 2005, Computer Supported Cooperative Work (CSCW).

[156]  C. Anandan,et al.  The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview , 2011, PLoS medicine.

[157]  Hans-Ulrich Prokosch,et al.  Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck , 2004, Int. J. Medical Informatics.

[158]  Jessica S. Ancker,et al.  The Triangle Model for evaluating the effect of health information technology on healthcare quality and safety , 2012, J. Am. Medical Informatics Assoc..

[159]  Manolis Tsiknakis,et al.  Organizational factors affecting successful adoption of innovative eHealth services: A case study employing the FITT framework , 2009, Int. J. Medical Informatics.

[160]  C. Goldzweig,et al.  Costs and benefits of health information technology: new trends from the literature. , 2009, Health affairs.

[161]  R. Scott,et al.  The socio-economic impact of telehealth: A systematic review , 2003, Journal of telemedicine and telecare.

[162]  Fiona Doolan-Noble,et al.  How well does your healthcare system perform? Tracking progress toward the triple aim using system level measures. , 2015, The New Zealand medical journal.

[163]  Graham Dickson,et al.  Transformations in Canadian health systems leadership: an analytical perspective , 2009 .

[164]  Prodromos D. Chatzoglou,et al.  Methods for evaluating hospital information systems: a literature review , 2008 .

[165]  Joan S. Ash,et al.  Research Paper: Types of Unintended Consequences Related to Computerized Provider Order Entry , 2006, J. Am. Medical Informatics Assoc..

[166]  Robert L. Wears,et al.  Health information technology: fallacies and sober realities , 2010, J. Am. Medical Informatics Assoc..

[167]  Richard J. Holden,et al.  Cognitive performance-altering effects of electronic medical records: an application of the human factors paradigm for patient safety , 2011, Cognition, Technology & Work.

[168]  D. Swinglehurst,et al.  Towards a better understanding of delivering e-health systems: a systematic review using the meta-narrative method and two case studies , 2011 .