Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries

BackgroundAlthough health technology assessment (HTA) systems base their decision making process either on economic evaluations or comparative clinical benefit assessment, a central aim of recent approaches to value measurement, including value based assessment and pricing, points towards the incorporation of supplementary evidence and criteria that capture additional dimensions of value.ObjectiveTo study the practices, processes and policies of value-assessment for new medicines across eight European countries and the role of HTA beyond economic evaluation and clinical benefit assessment.MethodsA systematic (peer review and grey) literature review was conducted using an analytical framework examining: (1) ‘Responsibilities and structure of HTA agencies’; (2) ‘Evidence and evaluation criteria considered in HTAs’; (3) ‘Methods and techniques applied in HTAs’; and (4) ‘Outcomes and implementation of HTAs’. Study countries were France, Germany, England, Sweden, Italy, Netherlands, Poland and Spain. Evidence from the literature was validated and updated through two rounds of feedback involving primary data collection from national experts.ResultsAll countries assess similar types of evidence; however, the specific criteria/endpoints used, their level of provision and requirement, and the way they are incorporated (e.g. explicitly vs. implicitly) varies across countries, with their relative importance remaining generally unknown. Incorporation of additional ‘social value judgements’ (beyond clinical benefit assessment) and economic evaluation could help explain heterogeneity in coverage recommendations and decision-making.ConclusionMore comprehensive and systematic assessment procedures characterised by increased transparency, in terms of selection of evaluation criteria, their importance and intensity of use, could lead to more rational evidence-based decision-making, possibly improving efficiency in resource allocation, while also raising public confidence and fairness.

[1]  M. Koopmanschap,et al.  Unravelling Drug Reimbursement Outcomes: A Comparative Study of the Role of Pharmacoeconomic Evidence in Dutch and Swedish Reimbursement Decision Making , 2013, PharmacoEconomics.

[2]  Isao Kamae,et al.  The ISPOR Good Practices for Quality Improvement of Cost-Effectiveness Research Task Force Report. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[3]  M. Vray,et al.  Évaluation médico-économique des produits de santé. Méthodologie pour la définition d’un impact significatif sur les dépenses de l’Assurance maladie et choix des référentiels pour l’interprétation des résultats , 2014 .

[4]  A. Towse,et al.  National Institute for Clinical Excellence (NICE): Is Economic Appraisal Working? , 2012, PharmacoEconomics.

[5]  Steve Morgan,et al.  Centralized drug review processes: are they fair? , 2006, Social science & medicine.

[6]  Mark Nuijten,et al.  Principles of good practice for budget impact analysis: report of the ISPOR Task Force on good research practices--budget impact analysis. , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[7]  N. Devlin,et al.  Operationalizing Value-Based Pricing of Medicines , 2012, PharmacoEconomics.

[8]  M. Drummond,et al.  Reimbursement of pharmaceuticals: reference pricing versus health technology assessment , 2010, The European Journal of Health Economics.

[9]  Hodgkin Lymphoma NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines , 2014 .

[10]  B. Falissard,et al.  Current process and future path for health economic assessment of pharmaceuticals in France , 2015, Journal of market access & health policy.

[11]  C. Lucioni,et al.  Spending on pharmaceuticals in Italy: macro constraints with local autonomy. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  M. Weinstein,et al.  QALYs: the basics. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  C. Carroll,et al.  Evidence Review Group approaches to the critical appraisal of manufacturer submissions for the NICE STA process: a mapping study and thematic analysis. , 2011, Health technology assessment.

[14]  M. Koopmanschap,et al.  SIMILARITIES AND DIFFERENCES BETWEEN FIVE EUROPEAN DRUG REIMBURSEMENT SYSTEMS , 2012, International Journal of Technology Assessment in Health Care.

[15]  Jing Jing Li,et al.  Using effectiveness and cost-effectiveness to make drug coverage decisions: a comparison of Britain, Australia, and Canada. , 2009, JAMA.

[16]  A. Stevens,et al.  HTA responses and the classic HTA report. , 2003, Journal of public health medicine.

[17]  Hilda Bastian,et al.  Die Entwicklung von Gesundheitsinformationen unter Beteiligung von Bürgerinnen und Bürgern am Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG). , 2011 .

[18]  P. Littlejohns,et al.  The National Institute for Health and Clinical Excellence and Its Role in Assessing the Value of New Cancer Treatments in England and Wales , 2011, Clinical Cancer Research.

[19]  C. Mitton,et al.  Priority setting in the provincial health services authority: survey of key decision makers , 2007, BMC Health Services Research.

[20]  Lawrence D. Phillips,et al.  Is quantitative benefit-risk modelling of drugs desirable or possible? , 2011, Drug discovery today. Technologies.

[21]  C. Donaldson,et al.  The New Myth , 2012, PharmacoEconomics.

[22]  A. Dhar,et al.  National Institute for Health and Clinical Excellence , 2005 .

[23]  G. Priol,et al.  What criteria for pharmaceuticals reimbursement? , 2003, The European Journal of Health Economics.

[24]  Steve Morgan,et al.  The Common Drug Review: a NICE start for Canada? , 2006, Health policy.

[25]  T. Philipson,et al.  Endogenous cost-effectiveness analysis and health care technology adoption. , 2013, Journal of health economics.

[26]  J. Belsey,et al.  Addressing the health technology assessment of biosimilar pharmaceuticals , 2010, Current medical research and opinion.

[27]  Thomas Mittendorf,et al.  Methods for determining cost-benefit ratios for pharmaceuticals in Germany , 2007, The European Journal of Health Economics.

[28]  S. Simoens Use of Economic Evaluation in Decision Making , 2010, Drugs.

[29]  M. Alajarin,et al.  General Methods , 2008 .

[30]  L. Mantovani,et al.  Guidelines for Economic Evaluations in Italy: Recommendations from The Italian Group of Pharmacoeconomic Studies , 2001 .

[31]  A. Culyer,et al.  NICE's social value judgements about equity in health and health care , 2012, Health Economics, Policy and Law.

[32]  Kalipso Chalkidou,et al.  Evidence and values: paying for end-of-life drugs in the British NHS , 2012, Health Economics, Policy and Law.

[33]  N. Samani,et al.  QALYs in cost-effectiveness analysis: an overview for cardiologists , 2015, Heart.

[34]  Norman Daniels,et al.  Decisions about access to health care and accountability for reasonableness , 1999, Journal of Urban Health.

[35]  K. Marsh,et al.  Assessing the Value of Healthcare Interventions Using Multi-Criteria Decision Analysis: A Review of the Literature , 2014, PharmacoEconomics.

[36]  Panos Kanavos,et al.  The impact of health technology assessments: an international comparison , 2010 .

[37]  David Barnett,et al.  Pharmacoeconomics: NICE's approach to decision-making. , 2010, British journal of clinical pharmacology.

[38]  A. Anell Priority setting for pharmaceuticals , 2004, The European Journal of Health Economics, formerly: HEPAC.

[39]  M. Willis,et al.  A case study of ex ante, value-based price and reimbursement decision-making: TLV and rimonabant in Sweden , 2010, The European Journal of Health Economics.

[40]  Steven Simoens,et al.  Paying for the Orphan Drug System: break or bend? Is it time for a new evaluation system for payers in Europe to take account of new rare disease treatments? , 2012, Orphanet Journal of Rare Diseases.

[41]  C. Mitton,et al.  Centralized drug review processes in Australia, Canada, New Zealand, and the United kingdom. , 2006, Health affairs.

[42]  Anthony J Culyer,et al.  National Institute for Clinical Excellence and its value judgments , 2004, BMJ : British Medical Journal.

[43]  J. Calltorp,et al.  Priority setting in health policy in Sweden and a comparison with Norway. , 1999, Health policy.

[44]  F. Antoñanzas Challenges to achieving value in drug spending in a decentralized country: the Spanish case. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[45]  M. Buxton Implications of the appraisal function of the National Institute for Clinical Excellence (NICE). , 2001, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[46]  Anton Berns,et al.  Separating the wheat from the chaff , 1991, Current Biology.

[47]  Uwe Siebert,et al.  Methods, procedures, and contextual characteristics of health technology assessment and health policy decision making: Comparison of health technology assessment agencies in Germany, United Kingdom, France, and Sweden , 2009, International Journal of Technology Assessment in Health Care.

[48]  A. Kilcoyne,et al.  The Institute for Quality and Efficiency in Health Care , 2013 .

[49]  W. Rogowski,et al.  Clearing up the hazy road from bench to bedside: A framework for integrating the fourth hurdle into translational medicine , 2008, BMC health services research.

[50]  E. Tacconelli Systematic reviews: CRD's guidance for undertaking reviews in health care , 2010 .

[51]  Katharina E. Fischer,et al.  Decision-making in healthcare: a practical application of partial least square path modelling to coverage of newborn screening programmes , 2012, BMC Medical Informatics and Decision Making.

[52]  B. Falissard,et al.  Current Process and Future Path for Health Economic Assessment of Pharmaceuticals in France. , 2015, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[53]  B. Corbacho,et al.  Health economic decision-making: a comparison between UK and Spain. , 2012, British medical bulletin.

[54]  R. Busse,et al.  Methods for the comparative evaluation of pharmaceuticals , 2005, GMS health technology assessment.

[55]  L. Shaw,et al.  ACC/AHA statement on cost/value methodology in clinical practice guidelines and performance measures: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures and Task Force on Practice Guidelines. , 2014, Journal of the American College of Cardiology.

[56]  Dana Goldman,et al.  Valuing health technologies at NICE: recommendations for improved incorporation of treatment value in HTA. , 2010, Health economics.

[57]  Nancy J Devlin,et al.  "Yes", "No" or "Yes, but"? Multinomial modelling of NICE decision-making. , 2006, Health policy.

[58]  B. Bégaud,et al.  How innovative are pharmaceutical innovations?: the case of medicines financed through add-on payments outside of the French DRG-based hospital payment system. , 2012, Health Policy.

[59]  Panos Kanavos,et al.  Commonalities and differences in HTA outcomes: a comparative analysis of five countries and implications for coverage decisions. , 2012, Health policy.

[60]  M. Koopmanschap,et al.  EUROPEAN DRUG REIMBURSEMENT SYSTEMS' LEGITIMACY: FIVE-COUNTRY COMPARISON AND POLICY TOOL , 2012, International Journal of Technology Assessment in Health Care.

[61]  A. Levy,et al.  Pharmacoeconomics and pharmacoepidemiology: curious bedfellows or a match made in heaven? , 2006, PharmacoEconomics (Auckland).

[62]  M. Cowie National Institute for Health and Care Excellence. , 2015, European heart journal.

[63]  Karl Claxton,et al.  Methods for the estimation of the National Institute for Health and Care Excellence cost-effectiveness threshold. , 2015, Health technology assessment.

[64]  H. Banta,et al.  Public health services and cost-effectiveness analysis. , 2008, Annual review of public health.

[65]  Deciding subsidy for pharmaceuticals based on ambiguous evidence. , 2008, Journal of health organization and management.

[66]  Paul Hansen,et al.  Health technology prioritization: which criteria for prioritizing new technologies and what are their relative weights? , 2011, Health policy.

[67]  J. Krell,et al.  The cost of a QALY. , 2010, QJM : monthly journal of the Association of Physicians.

[68]  Jon Sussex,et al.  Operationalising Value Based Pricing of Medicines: A Taxonomy of Approaches , 2011 .

[69]  P. Kanavos,et al.  Critique of the American Society of Clinical Oncology Value Assessment Framework for Cancer Treatments: Putting Methodologic Robustness First. , 2016, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[70]  F. Schubert HEALTH TECHNOLOGY ASSESSMENT , 2002, International Journal of Technology Assessment in Health Care.

[71]  David Parkin,et al.  Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. , 2004, Health economics.

[72]  Belen Corbacho,et al.  Relative effectiveness assessment of pharmaceuticals: similarities and differences in 29 jurisdictions. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[73]  J. Huisman The Netherlands , 1996, The Lancet.

[74]  M. Mckee,et al.  The politics of health technology assessment in Poland. , 2012, Health policy.

[75]  G. Priol,et al.  What criteria for pharmaceuticals reimbursement? An empirical analysis of the evaluation of "medical service rendered" by reimbursable drugs in France. , 2003, The European journal of health economics : HEPAC : health economics in prevention and care.

[76]  Martin Hoyle,et al.  Historical lifetimes of drugs in England: application to value of information and cost-effectiveness analyses. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[77]  Joshua A Hirsch,et al.  Facts, fallacies, and politics of comparative effectiveness research: Part 2 - implications for interventional pain management. , 2010, Pain physician.

[78]  F. Dionne,et al.  Decision maker views on priority setting in the Vancouver Island Health Authority , 2008, Cost effectiveness and resource allocation : C/E.

[79]  D. Banta The development of health technology assessment. , 2003, Health policy.

[80]  Aris Angelis,et al.  Value-Based Assessment of New Medical Technologies: Towards a Robust Methodological Framework for the Application of Multiple Criteria Decision Analysis in the Context of Health Technology Assessment , 2016, PharmacoEconomics.

[81]  M. Piccart,et al.  A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS). , 2015, Annals of oncology : official journal of the European Society for Medical Oncology.

[82]  M. Postma,et al.  Quantification of the potential impact of cost-effectiveness thresholds on dutch drug expenditures using retrospective analysis. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[83]  J. Dettori,et al.  Health technology assessment , 2009, International Journal of Technology Assessment in Health Care.

[84]  Adam P Dicker,et al.  American Society of Clinical Oncology Statement: A Conceptual Framework to Assess the Value of Cancer Treatment Options. , 2015, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[85]  M. Piccart,et al.  A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS). , 2015, Annals of oncology : official journal of the European Society for Medical Oncology.

[86]  M. Drummond,et al.  Differences among formulary submission guidelines: Implications for health technology assessment , 2011, International Journal of Technology Assessment in Health Care.

[87]  E. Nicod,et al.  Developing an evidence-based methodological framework to systematically compare HTA coverage decisions: A mixed methods study. , 2016, Health policy.

[88]  F. Nilsson,et al.  Reimbursement Decisions for Pharmaceuticals in Sweden: The Impact of Disease Severity and Cost Effectiveness , 2015, PharmacoEconomics.

[89]  C. Dirksen,et al.  Integrating evidence on patient preferences in healthcare policy decisions: protocol of the patient-VIP study , 2013, Implementation Science.

[90]  Maarten J. IJzerman,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[91]  Clare McGrath,et al.  Framework for describing and classifying decision-making systems using technology assessment to determine the reimbursement of health technologies (fourth hurdle systems) , 2006, International Journal of Technology Assessment in Health Care.

[92]  N. Kenny,et al.  An Ethical Analysis of International Health Priority-Setting , 2008, Health Care Analysis.

[93]  A. Anell Priority setting for pharmaceuticals. The use of health economic evidence by reimbursement and clinical guidance committees. , 2004, The European journal of health economics : HEPAC : health economics in prevention and care.

[94]  J. Moisan,et al.  Inter-provincial variation in government drug formularies. , 2001, Canadian journal of public health = Revue canadienne de sante publique.

[95]  James Raftery,et al.  Commentary: A clinical challenge , 2006, BMJ : British Medical Journal.