Forecasting Implementation, Adoption, and Evaluation Challenges for an Electronic Game–Based Antimicrobial Stewardship Intervention: Co-Design Workshop With Multidisciplinary Stakeholders

Background Serious games have been proposed to address the lack of engagement and sustainability traditionally affecting interventions aiming to improve optimal antibiotic use among hospital prescribers. Objective The goal of the research was to forecast gaps in implementation, adoption and evaluation of game-based interventions, and co-design solutions with antimicrobial clinicians and digital and behavioral researchers. Methods A co-development workshop with clinicians and academics in serious games, antimicrobials, and behavioral sciences was organized to open the International Summit on Serious Health Games in London, United Kingdom, in March 2018. The workshop was announced on social media and online platforms. Attendees were asked to work in small groups provided with a laptop/tablet and the latest version of the game On call: Antibiotics. A workshop leader guided open group discussions around implementation, adoption, and evaluation threats and potential solutions. Workshop summary notes were collated by an observer. Results There were 29 participants attending the workshop. Anticipated challenges to resolve reflected implementation threats such as an inadequate organizational arrangement to scale and sustain the use of the game, requiring sufficient technical and educational support and a streamlined feedback mechanism that made best use of data arriving from the game. Adoption threats included collective perceptions that a game would be a ludic rather than professional tool and demanding efforts to integrate all available educational solutions so none are seen as inferior. Evaluation threats included the need to combine game metrics with organizational indicators such as antibiotic use, which may be difficult to enable. Conclusions As with other technology-based interventions, deploying game-based solutions requires careful planning on how to engage and support clinicians in their use and how best to integrate the game and game outputs onto existing workflows. The ludic characteristics of the game may foster perceptions of unprofessionalism among gamers, which would need buffering from the organization.

[1]  C. Mcnulty,et al.  Improving the quality of antibiotic prescribing in the NHS by developing a new Antimicrobial Stewardship Programme: Start Smart--Then Focus. , 2012, The Journal of antimicrobial chemotherapy.

[2]  M. Schijven,et al.  Systematic review of serious games for medical education and surgical skills training , 2012, The British journal of surgery.

[3]  Luke S P Moore,et al.  Antimicrobials: access and sustainable eff ectiveness 2 Understanding the mechanisms and drivers of antimicrobial resistance , 2015 .

[4]  S. Reeves,et al.  Development of consensus-based national antimicrobial stewardship competencies for UK undergraduate healthcare professional education. , 2018, The Journal of hospital infection.

[5]  S. Vañó-Galvan,et al.  Knowledge and perceptions of junior and senior Spanish resident doctors about antibiotic use and resistance: results of a multicenter survey. , 2013, Enfermedades infecciosas y microbiologia clinica.

[6]  O. Dyar,et al.  ESCMID generic competencies in antimicrobial prescribing and stewardship: towards a European consensus. , 2019, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[7]  A. Holmes,et al.  Antimicrobial stewardship: are we failing in cross-specialty clinical engagement? , 2016, The Journal of antimicrobial chemotherapy.

[8]  A. Molnar Antimicrobial Resistance Awareness and Games. , 2019, Trends in microbiology.

[9]  Jorie M. Butler,et al.  Think twice: A cognitive perspective of an antibiotic timeout intervention to improve antibiotic use. , 2017, Journal of biomedical informatics.

[10]  M. Edye,et al.  Educational Antimicrobial Stewardship Intervention Ineffective in Changing Surgical Prophylactic Antibiotic Prescribing. , 2016, Surgical infections.

[11]  N. Sevdalis,et al.  Understanding the Determinants of Antimicrobial Prescribing Within Hospitals: The Role of “Prescribing Etiquette” , 2013, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[12]  S. Hoffman,et al.  Mapping educational opportunities for healthcare workers on antimicrobial resistance and stewardship around the world , 2018, Human Resources for Health.

[13]  Trisha Greenhalgh,et al.  Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies , 2017, Journal of medical Internet research.

[14]  David A. Ellis,et al.  The Technology Integration Model (TIM). Predicting the continued use of technology , 2018, Comput. Hum. Behav..

[15]  M. Hulscher,et al.  Patient-related determinants of antibiotic use: a systematic review. , 2019, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[16]  I. Wacogne,et al.  UK recommendations for combating antimicrobial resistance: a review of ‘antimicrobial stewardship: systems and processes for effective antimicrobial medicine use’ (NICE guideline NG15, 2015) and related guidance , 2017, Archives of Disease in Childhood: Education & Practice Edition.

[17]  Sylvie Cossette,et al.  Effectiveness of serious games and impact of design elements on engagement and educational outcomes in healthcare professionals and students: a systematic review and meta-analysis protocol , 2018, BMJ Open.

[18]  Yiannis Kyratsis,et al.  Serious electronic games as behavioural change interventions in healthcare-associated infections and infection prevention and control: a scoping review of the literature and future directions , 2016, Antimicrobial Resistance & Infection Control.

[19]  Tiago Oliveira,et al.  Gamification and serious games: A literature meta-analysis and integrative model , 2019, Comput. Hum. Behav..

[20]  K. Mertens,et al.  Attributable deaths and disability-adjusted life-years caused by infections with antibiotic-resistant bacteria in the EU and the European Economic Area in 2015: a population-level modelling analysis , 2019, The Lancet. Infectious diseases.

[21]  Yujong Hwang,et al.  Understanding technology acceptance features in learning through a serious game , 2018, Comput. Hum. Behav..

[22]  Alexander Maedche,et al.  Gamified crowdsourcing: Conceptualization, literature review, and future agenda , 2017, Int. J. Hum. Comput. Stud..

[23]  Alexandra Pomares,et al.  A systematic review of serious games in medical education: quality of evidence and pedagogical strategy , 2018, Medical education online.

[24]  S. Gandra,et al.  Economic burden of antibiotic resistance: how much do we really know? , 2014, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[25]  M. Gharbi,et al.  Mapping Antimicrobial Stewardship in Undergraduate Medical, Dental, Pharmacy, Nursing and Veterinary Education in the United Kingdom , 2016, PloS one.

[26]  Geertje Bekebrede,et al.  The research and evaluation of serious games: Toward a comprehensive methodology , 2014, Br. J. Educ. Technol..

[27]  A. Broom,et al.  Medical authority, managerial power and political will: A Bourdieusian analysis of antibiotics in the hospital , 2018, Health.

[28]  O. Dyar,et al.  European medical students: a first multicentre study of knowledge, attitudes and perceptions of antibiotic prescribing and antibiotic resistance. , 2014, The Journal of antimicrobial chemotherapy.

[29]  O. Dyar,et al.  What is antimicrobial stewardship? , 2017, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[30]  T. Hoffmann,et al.  Not in my backyard: a systematic review of clinicians' knowledge and beliefs about antibiotic resistance. , 2015, The Journal of antimicrobial chemotherapy.

[31]  Herman Goossens,et al.  A systematic review and meta-analysis of the effects of antibiotic consumption on antibiotic resistance , 2014, BMC Infectious Diseases.

[32]  Daniel Katz,et al.  A Systematic Review of Serious Games in Training Health Care Professionals , 2016, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[33]  J. Whitty,et al.  Antibiotic prescribing in primary healthcare: Dominant factors and trade-offs in decision-making , 2018, Infection, Disease & Health.

[34]  S. Barnes,et al.  The Impact of Antibiotic Stewardship Program Resources on Infection Prevention Programs. , 2018, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.