A qualitative exploration of early assessment of innovative medical technologies

BackgroundHospitals increasingly make decisions about early development of and investment in innovative medical technologies (IMTs), but at present often without an early assessment of their potential to ensure selection of the most promising candidates for further development. This paper explores how early assessment is carried out in different health organisations and then discusses relevant learning points for hospitals.MethodsA qualitative study design with a structured interview guide covering four themes was used. Content analyses of interview notes were performed covering four predetermined themes: context, basis for decision-making, process and structure, and perceptions. A fifth theme, handling cognitive bias, was identified during data analysis.ResultsA total of 11 organisations participated; eight from the private health industry and three public hospitals. The interviews identified four areas in which early assessment is performed in similar manner across the studied organisations and four areas where differences exist between public hospitals and private organisations. Public hospitals indicate a lower degree of formalised early assessment and less satisfaction with how early assessment is performed, compared to private organisations. Based on the above findings, two learning points may carry promise for hospitals. First, having dedicated prioritising committees for IMTs making stop/go decisions. This committee is separate from the IMT development processes and involved staff. Secondly, the committee should base decisions on a transparent early assessment decision-support tool, which include a broad set of domains, is iterative, describes uncertainty, and minimise cognitive biases.ConclusionsSimilarities and differences in the way early assessment is done in different health organisations were identified. These findings suggest promising learning points for the development of an early assessment model for hospitals.

[1]  Laura Vallejo-Torres,et al.  Integrating health economics modeling in the product development cycle of medical devices: A Bayesian approach , 2008, International Journal of Technology Assessment in Health Care.

[2]  Faïz Gallouj,et al.  Public-Private Partnerships in Hospital Innovation: What lessons for hospital management? , 2013 .

[3]  A. Tricco,et al.  Early economic evaluation of emerging health technologies: protocol of a systematic review , 2014, Systematic Reviews.

[4]  P. J. Chilton,et al.  Evaluation of a predevelopment service delivery intervention: an application to improve clinical handovers , 2012, BMJ quality & safety.

[5]  Linda S. Lotto Qualitative Data Analysis: A Sourcebook of New Methods , 1986 .

[6]  W. Schnotz,et al.  A Reconsideration of Cognitive Load Theory , 2007 .

[7]  G. Meyer,et al.  The potential of actuarial decision models: Can they improve the venture capital investment decision? , 2000 .

[8]  Marc Bartelmes,et al.  Methods for assessment of innovative medical technologies during early stages of development , 2009, GMS health technology assessment.

[9]  D. Kahneman Thinking, Fast and Slow , 2011 .

[10]  Alison Bowes,et al.  Early telemedicine training and counselling after hospitalization in patients with severe chronic obstructive pulmonary disease: a feasibility study , 2015, BMC Medical Informatics and Decision Making.

[11]  U. Halekoh,et al.  Validation of a new imaging device for telemedical ulcer monitoring , 2015, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[12]  Samir Elhedhli,et al.  The Effectiveness of Simple Decision Heuristics: Forecasting Commercial Success for Early-Stage Ventures , 2006, Manag. Sci..

[13]  Dorthe Boe Danbjørg,et al.  Designing, Developing, and Testing an App for Parents Being Discharged Early Postnatally , 2014 .

[14]  Iben Fasterholdt Early realistic assessment of innovative medical technologies in hospitals (EARTH) , 2018 .

[15]  Susanne Hartz,et al.  Contribution of economic evaluation to decision making in early phases of product development: A methodological and empirical review , 2008, International Journal of Technology Assessment in Health Care.

[16]  L. Ballini,et al.  A method for addressing research gaps in HTA, developed whilst evaluating robotic-assisted surgery: a proposal , 2010, Health research policy and systems.

[17]  Ana Escoval,et al.  Improvement of Hospital Performance Through Innovation: Toward the Value of Hospital Care , 2013, The health care manager.

[18]  Jean-Louis Denis,et al.  Providing Value to New Health Technology: The Early Contribution of Entrepreneurs, Investors, and Regulatory Agencies , 2017, International journal of health policy and management.

[19]  S. Ramsey,et al.  Improving early cycle economic evaluation of diagnostic technologies , 2014, Expert review of pharmacoeconomics & outcomes research.

[20]  S. Kvale,et al.  InterViews: Learning the Craft of Qualitative Research Interviewing , 1996 .

[21]  Alexandre Barna,et al.  A toolkit for the identification and assessment of new and emerging health technologies 2014 , 2014 .

[22]  Naihua Duan,et al.  Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research , 2015, Administration and Policy in Mental Health and Mental Health Services Research.

[23]  Kultar Singh,et al.  Quantitative Social Research Methods , 2007 .

[24]  Murray Krahn,et al.  Review of early assessment models of innovative medical technologies. , 2017, Health policy.

[25]  K. Malterud,et al.  Sample Size in Qualitative Interview Studies , 2016, Qualitative health research.

[26]  A. Huberman,et al.  Qualitative Data Analysis: A Methods Sourcebook , 1994 .

[27]  William White,et al.  A Proposal , 2008, Moon, Sun, and Witches.

[28]  Eric Bonabeau,et al.  A more rational approach to new-product development. , 2008, Harvard business review.

[29]  Maarten Joost IJzerman,et al.  Evaluation of new technology in health care: in need of guidance for relevant evidence , 2014 .

[30]  Brian Hobbs,et al.  Discriminating Contexts and Project Management Best Practices on Innovative and Noninnovative Projects , 2008 .

[31]  Jeffrey K. Pinto,et al.  Project Management: Achieving Competitive Advantage , 2003 .