Expert Elicitation to Inform Health Technology Assessment

In the face of constrained budgets, unavoidable decisions about the use of health care interventions have to be made. Decision makers seeking to maximise health for their given budget should use the best available information on effectiveness and cost-effectiveness, and for this purpose they may use a process of gathering and combining existing evidence in this context called Health Technology Assessment (HTA). In informing decisions, utilising HTA, expert elicitation can provide valuable information, particularly where evidence is missing, where it may not be as well developed (e.g. diagnostics, medical devices, early access to medicines scheme or public health) or limited (insufficient, not very relevant, contradictory and/or flawed). Here, formal methods to elicit expert judgements are preferred to improve the accountability and transparency of the decision making process, in addition to the important role in reducing bias and the use of heuristics. There have been a limited number of applications of expert elicitation in health care decision making, and in part this may be due to a number of methodological uncertainties regarding the applicability and transferability of techniques from other disciples, such as Bayesian statistics and engineering, to health care. This chapter discusses the distinguishing features of health care decision making and the use of expert elicitation to inform this, drawing on applied examples in the area illustrating some of the complexities and uncertainties.

[1]  Wendy Armstrong,et al.  Building on Values: The Future of Health Care in Canada , 2005 .

[2]  Karl Claxton,et al.  Methods to Assess Cost-Effectiveness and Value of Further Research When Data Are Sparse , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[3]  Nicky J Welton,et al.  Treatment comparisons for decision making: facing the problems of sparse and few data , 2014 .

[4]  J. Peters,et al.  Methods to Elicit Probability Distributions from Experts: A Systematic Review of Reported Practice in Health Technology Assessment , 2013, PharmacoEconomics.

[5]  M. Drummond,et al.  Whither trial-based economic evaluation for health care decision making? , 2006, Health economics.

[6]  K Claxton,et al.  The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. , 1999, Journal of health economics.

[7]  A H Briggs,et al.  A Bayesian approach to stochastic cost-effectiveness analysis. , 1999, Health economics.

[8]  A. Culyer,et al.  Equity and equality in health and health care. , 1993, Journal of health economics.

[9]  Ken Stein,et al.  A comparison of two methods for expert elicitation in health technology assessments , 2016, BMC Medical Research Methodology.

[10]  Nicky Cullum,et al.  Methods to elicit experts’ beliefs over uncertain quantities: application to a cost effectiveness transition model of negative pressure wound therapy for severe pressure ulceration , 2011, Statistics in medicine.

[11]  Jeremy E. Oakley,et al.  A web-based tool for eliciting probability distributions from experts , 2014, Environ. Model. Softw..

[12]  Stirling Bryan,et al.  Seeing the NICE side of cost-effectiveness analysis: a qualitative investigation of the use of CEA in NICE technology appraisals. , 2007, Health economics.

[13]  John Paul Gosling,et al.  SHELF: The Sheffield Elicitation Framework , 2018 .

[14]  M. Drummond,et al.  Health Care Technology: Effectiveness, Efficiency and Public Policy@@@Methods for the Economic Evaluation of Health Care Programmes , 1988 .

[15]  K. Payne,et al.  Reporting Guidelines for the Use of Expert Judgement in Model-Based Economic Evaluations , 2016, PharmacoEconomics.

[16]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[17]  Maarten J. IJzerman,et al.  Belief Elicitation to Populate Health Economic Models of Medical Diagnostic Devices in Development , 2014, Applied Health Economics and Health Policy.

[18]  Katherine Payne,et al.  The Appropriate Elicitation of Expert Opinion in Economic Models , 2011, PharmacoEconomics.

[19]  T. Modis,et al.  Experts in uncertainty , 1993 .

[20]  John Quigley,et al.  Reaction to ‘An approach to perform expert elicitation for engineering design risk analysis: methodology and experimental results’ , 2014 .

[21]  Mark J Sculpher,et al.  Dangerous omissions: the consequences of ignoring decision uncertainty. , 2011, Health economics.