Eliciting public preferences for healthcare: a systematic review of techniques.

BACKGROUND Limited resources coupled with unlimited demand for healthcare mean that decisions have to be made regarding the allocation of scarce resources across competing interventions. Policy documents have advocated the importance of public views as one such criterion. In principle, the elicitation of public values represents a big step forward. However, for the exercise to be worthwhile, useful information must be obtained that is scientifically defensible, whilst decision-makers must be able and willing to use it. AIMS AND OBJECTIVES The aim was to identify techniques that could be reasonably used to elicit public views on the provision of healthcare. Hence, the objectives were: (1) to identify research methods with the potential to take account of public views on the delivery of healthcare; (2) to identify criteria for assessing these methods; (3) to assess the methods identified according to the predefined criteria; (4) to assess the importance of public views vis-à-vis other criteria for setting priorities, as judged by a sample of decision-makers; (5) to make recommendations regarding the use of methods and future research. METHODS A systematic literature review was carried out to identify methods for eliciting public views. Criteria currently used to evaluate such methods were identified. The methods identified were then evaluated according to predefined criteria. A questionnaire-based survey assessed the relative importance of public views vis-à-vis five other criteria for setting priorities: potential health gain; evidence of clinical effectiveness; budgetary impact; equity of access and health status inequalities; and quality of service. Two techniques were used: choice-based conjoint analysis and allocation of points technique. The questionnaire was sent to 143 participants. A subsample was followed up with a telephone interview. RESULTS The methods identified were classified as quantitative or qualitative. RESULTS - QUANTITATIVE TECHNIQUES: Quantitative techniques, classified as ranking, rating or choice-based approaches, were evaluated according to eight criteria: validity; reproducibility; internal consistency; acceptability to respondents; cost (financial and administrative); theoretical basis; whether the technique offered a constrained choice; and whether the technique provided a strength of preference measure. Regarding ranking exercises, simple ranking exercises have proved popular, but their results are of limited use. The qualitative discriminant process has not been used to date in healthcare, but may be useful. Conjoint analysis ranking exercises did well against the above criteria. A number of rating scales were identified. The visual analogue scale has proved popular within the quality-adjusted life-year paradigm, but lacks constrained choice and may not measure strength of preference. However, conjoint analysis rating scales performed well. Methods identified for eliciting attitudes include Likert scales, the semantic differential technique, and the Guttman scale. These methods provide useful information, but do not consider strength of preference or the importance of different components within a total score. Satisfaction surveys have been frequently used to elicit public opinion. Researchers should ensure that they construct sensitive techniques, despite their limited use, or else use generic techniques where validity has already been established. Service quality (SERVQUAL) appears to be a potentially useful technique and its application should be researched. Three choice-based techniques with a limited application in healthcare are measure of value, the analytical hierarchical process and the allocation of points technique, while those more widely used, and which did well against the predefined criteria, include standard gamble, time trade-off, discrete choice conjoint analysis and willingness to pay. Little methodological work is currently available on the person trade-off. RESULTS - QUALITATIVE TECHNIQUES: Qualitative techniques were classified as either individual or group-based approaches. Individual approaches included one-to-one interviews, dyadic interviews, case study analyses, the Delphi technique and complaints procedures. Group-based methods included focus groups, concept mapping, citizens' juries, consensus panels, public meetings and nominal group techniques. Six assessment criteria were identified: validity; reliability; generalisability; objectivity; acceptability to respondents; and cost. Whilst all the methods have distinct strengths and weaknesses, there is a lot of ambiguity in the literature. Whether to use individual or group methods depends on the specific topic being discussed and the people being asked, but for both it is crucial that the interviewer/moderator remains as objective as possible. The most popular and widely used such methods were one-to-one interviews and focus groups. (ABSTRACT TRUNCATED)

[1]  G. Loewenstein,et al.  Value measurement in cost-utility analysis: explaining the discrepancy between rating scale and person trade-off elicitations. , 1998, Health policy.

[2]  B. New,et al.  Setting priorities: is there a role for citizens' juries? , 1996, BMJ.

[3]  M. Johannesson,et al.  Standard gamble, time trade-off and rating scale: experimental results on the ranking properties of QALYs. , 1997, Journal of health economics.

[4]  G. Hoinville,et al.  Evaluating Community Preferences , 1971 .

[5]  N. Reid,et al.  Customer complaints in the National Health Service. , 1995, Journal of nursing management.

[6]  M. Ryan Valuing psychological factors in the provision of assisted reproductive techniques using the economic instrument of willingness to pay , 1998 .

[7]  D. Lansky,et al.  Evaluating a patient satisfaction survey for maximum benefit. , 1994, The Joint Commission journal on quality improvement.

[8]  B. Roe,et al.  Telephone or face-to-face interviews?: a decision made on the basis of a pilot study. , 1998, International journal of nursing studies.

[9]  L. Irwig,et al.  Development and validation of an instrument to measure satisfaction of participants at breast screening programmes. , 1991, European journal of cancer.

[10]  T. A. Festervand,et al.  An introduction and application of focus group research to the health care industry. , 1985, Health marketing quarterly.

[11]  J McMillan Priority Setting and the Public , 2002 .

[12]  M Ryan,et al.  Methodological issues in the application of conjoint analysis in health care. , 1998, Health economics.

[13]  D L Patrick,et al.  Methods for measuring levels of well-being for a health status index. , 1973, Health services research.

[14]  T. J. Burns,et al.  Primary health care needs of persons with physical disabilities: what are the research and service priorities? , 1990, Archives of physical medicine and rehabilitation.

[15]  I. Russell,et al.  Patient centred assessment of quality of life for patients with four common conditions. , 1999, Quality in health care : QHC.

[16]  R. Fitzpatrick,et al.  Surveys of patients satisfaction: I--Important general considerations. , 1991, BMJ.

[17]  C. Fargason,et al.  Preferences of pregnant women and physicians for 2 strategies for prevention of early-onset group B streptococcal sepsis in neonates. , 1997, Archives of pediatrics & adolescent medicine.

[18]  P. Dolan,et al.  Time preference, duration and health state valuations. , 1995, Health economics.

[19]  A Shiell,et al.  Values and preferences are not necessarily the same. , 1997, Health economics.

[20]  Mandy Ryan,et al.  Testing for consistency in willingness to pay experiments , 2000 .

[21]  M. Holmes-Rovner,et al.  Patient Satisfaction with Health Care Decisions , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  S. Redman,et al.  Consulting about priorities for the NHMRC National Breast Cancer Centre: how good is the nominal group technique , 1977, Australian and New Zealand journal of public health.

[23]  Alan Randall,et al.  Too Many Proposals Pass the Benefit-Cost Test: Reply , 1989 .

[24]  M. Ryan Using willingness to pay to assess the benefits of assisted reproductive techniques. , 1996, Health economics.

[25]  P. Lewis,et al.  Which of two individuals do you treat when only their ages are different and you can't treat both? , 1989, Journal of medical ethics.

[26]  J G Dolan,et al.  Are Patients Capable of Using the Analytic Hierarchy Process and Willing to Use It to Help Make Clinical Decisions? , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[27]  Yoram Wind,et al.  Subjective evaluation models and conjoint measurement , 1972 .

[28]  J. Shogren,et al.  Resolving Differences in Willingness to Pay and Willingness to Accept , 1997 .

[29]  J. Cairns,et al.  Establishing Patient Preferences for Blood Transfusion Support: An Application of Conjoint Analysis , 1998, Journal of health services research & policy.

[30]  J. Cumming,et al.  Core services and priority-setting: the New Zealand experience. , 1994, Health policy.

[31]  E. Nord The Person-trade-off Approach to Valuing Health Care Programs , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  Rakesh K. Sarin,et al.  RELATIVE RISK AVERSION. , 1982 .

[33]  G. Torrance Measurement of health state utilities for economic appraisal. , 1986, Journal of health economics.

[34]  Mandy Ryan,et al.  Using conjoint analysis to establish consumer preferences for fruit and vegetables , 1996 .

[35]  S. Fihn,et al.  Symptom Severity and Patients' Values in the Decision to Perform a Transurethral Resection of the Prostate , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[36]  M J Buxton,et al.  Evaluating patient-based outcome measures for use in clinical trials. , 1998, Health technology assessment.

[37]  B. Wyse,et al.  Nutrition labels in bar graph format deemed most useful for consumer purchase decisions using adaptive conjoint analysis. , 1991, Journal of the American Dietetic Association.

[38]  Joel Huber,et al.  Pricing environmental health risks: survey assessments of risk-risk and risk-dollar trade-offs for chronic bronchitis☆ , 1991 .

[39]  J. Bosch,et al.  The Relationship between Descriptive and Valuational Quality-of-life Measures in Patients with Intermittent Claudication , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[40]  Simon S. K. Lam,et al.  SERVQUAL: A tool for measuring patients' opinions of hospital service quality in Hong Kong , 1997 .

[41]  R. Ford,et al.  Methods of Measuring Patient Satisfaction in Health Care Organizations , 1997, Health care management review.

[42]  P. Glasziou,et al.  Quality of life six months after myocardial infarction treated with thrombolytic therapy , 1994, The Medical journal of Australia.

[43]  Y. Katz,et al.  A Gutyman Scale Factor Structure of Comprehensiveness , 1993 .

[44]  D. Booth,et al.  Influences on Meat Avoidance Among British Students , 1996, Appetite.

[45]  D. Coakley,et al.  Measuring the Quality of Life of Dementia Patients Using the Schedule for the Evaluation of Individual Quality of Life , 1993 .

[46]  A. Bisset,et al.  Is this satisfaction survey satisfactory? Some points to consider in their planning and assessment. , 2000, Health bulletin.

[47]  B. Hulka,et al.  Validation of a patient satisfaction scale: theory, methods and practice. , 1982, Medical care.

[48]  A. Hopkins,et al.  Problems in the conceptual framework of patient satisfaction research: an empirical exploration. , 1983, Sociology of health & illness.

[49]  R. Reidenbach,et al.  Exploring perceptions of hospital operations by a modified SERVQUAL approach. , 1990, Journal of health care marketing.

[50]  M. Ryan,et al.  A ROLE FOR CONJOINT ANALYSIS IN TECHNOLOGY ASSESSMENT IN HEALTH CARE? , 1999, International Journal of Technology Assessment in Health Care.

[51]  M. Ryan,et al.  Using Consumer Preferences in Health Care Decision Making: The Application of Conjoint Analysis , 1996 .

[52]  J. Ratcliffe,et al.  PATIENTS' PREFERENCES REGARDING THE PROCESS AND OUTCOMES OF LIFE-SAVING TECHNOLOGY , 1999, International Journal of Technology Assessment in Health Care.

[53]  R. Baker,et al.  Development of a questionnaire to assess patients' satisfaction with consultations in general practice. , 1990, The British journal of general practice : the journal of the Royal College of General Practitioners.

[54]  C. Pope,et al.  Qualitative Research: Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research , 1995 .

[55]  M. Thase,et al.  The National Depressive and Manic-Depressive Association consensus statement on the undertreatment of depression. , 1997, JAMA.

[56]  Penelope M. Mullen,et al.  Public involvement in health care priority setting: an overview of methods for eliciting values , 1999, Health expectations : an international journal of public participation in health care and health policy.

[57]  E. Irvine Quality of Life in inflammatory bowel disease: biases and other factors affecting scores. , 1995, Scandinavian journal of gastroenterology. Supplement.

[58]  Arlene G. Fink,et al.  Evaluation Fundamentals: Guiding Health Programs, Research, and Policy , 1993 .

[59]  E. O'Shea,et al.  Care provision and dependency in long-stay institutions , 1997 .

[60]  S. Sabourin,et al.  Are consumers of modern fertility treatments satisfied? , 1992, Fertility and Sterility.

[61]  M K Goldstein,et al.  Measurement of the validity of utility elicitations performed by computerized interview. , 1997, Medical care.

[62]  J. Kenneth Buckingham,et al.  Comparing Three Versions of the Time Tradeoff , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[63]  S. Gabriel,et al.  Patient preferences for nonsteroidal antiinflammatory drug related gastrointestinal complications and their prophylaxis. , 1993, The Journal of rheumatology.

[64]  J. Kitzinger The methodology of focus groups: the importance of interaction between research participants , 1994 .

[65]  D. Feeny,et al.  Multiattribute utility function for a comprehensive health status classification system. Health Utilities Index Mark 2. , 1996, Medical care.

[66]  P. Shackley,et al.  Using conjoint analysis to elicit the views of health service users: an application to the patient health card , 1998, Health expectations : an international journal of public participation in health care and health policy.

[67]  M. Avis,et al.  Questioning patient satisfaction: An empirical investigation in two outpatient clinics , 1997 .

[68]  S. S. Stevens,et al.  A metric for the social consensus. , 1966, Science.

[69]  H. Welch,et al.  Priority setting: lessons from Oregon , 1991, The Lancet.

[70]  R. Powell,et al.  Focus Groups in Mental Health Research: Enhancing the Validity of User and Provider Questionnaires , 1996, The International journal of social psychiatry.

[71]  John H. Aldrich,et al.  The Measurement of Public Opinion about Public Policy: A Report on Some New Issue Question Formats* , 1982 .

[72]  R. Baker,et al.  The reliability and criterion validity of a measure of patients' satisfaction with their general practice. , 1991, Family practice.

[73]  George W. Torrance,et al.  Social preferences for health states: An empirical evaluation of three measurement techniques , 1976 .

[74]  P. Shackley,et al.  Willingness to pay for antenatal carrier screening for cystic fibrosis. , 1995, Health economics.

[75]  D A Revicki,et al.  Relationship between health utility and psychometric health status measures. , 1992, Medical care.

[76]  P. Slovic,et al.  Preference Reversals: A Broader Perspective , 1983 .

[77]  G. Loewenstein,et al.  Individual Utilities Are Inconsistent with Rationing Choices , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[78]  L. Worrall-Carter,et al.  Basic concepts for qualitative research , 1998 .

[79]  Maureen,et al.  Methodological Issues of Patient Utility Measurement Experience From Two Clinical Trials , 1995, Medical care.

[80]  J. L. Prades IS THE PERSON TRADE-OFF A VALID METHOD FOR ALLOCATING HEALTH CARE RESOURCES , 1997 .

[81]  P. Shackley,et al.  Stepwise or couple antenatal carrier screening for cystic fibrosis?: women's preferences and willingness to pay. , 1995, Journal of medical genetics.

[82]  L. Delene,et al.  Measuring physician attitudes of service quality. , 1993, Journal of health care marketing.

[83]  A. D. Ball,et al.  Stage of quitting and motivational factors relevant to smoking cessation program choices. , 1993 .

[84]  S C Farrow,et al.  Choosing who shall not be treated in the NHS. , 1989, Social science & medicine.

[85]  B. Littenberg,et al.  Assessing the preferences of patients with psoriasis. A quantitative, utility approach. , 1995, Archives of dermatology.

[86]  Marcel R. Kastein,et al.  Delphi, the issue of reliability , 1993 .

[87]  C. O'boyle,et al.  Assessing the quality of life of the individual: the SEIQoL with a healthy and a gastroenterology unit population , 1991, Psychological Medicine.

[88]  A. Tversky,et al.  Prospect Theory. An Analysis of Decision Making Under Risk , 1977 .

[89]  P. Petersen Guttman scale analysis of dental health attitudes and knowledge. , 1989, Community dentistry and oral epidemiology.

[90]  P. Walter Quality of Life after Open Heart Surgery , 1992, Developments in Cardiovascular Medicine.

[91]  R. Swain,et al.  The effects of a participative programme on Irish pupils' attitudes to HIV/AIDS. , 1997, Health education research.

[92]  C. Bowles Measure of Attitude Toward Menopause Using the Semantic Differential Model , 1986, Nursing research.

[93]  D. Locker,et al.  Theoretical and methodological issues in sociological studies of consumer satisfaction with medical care. , 1978, Social science & medicine.

[94]  M. Ryan Using conjoint analysis to take account of patient preferences and go beyond health outcomes: an application to in vitro fertilisation. , 1999, Social science & medicine.

[95]  D. Heisey,et al.  MR and conventional angiography: work in progress toward assessing utility in radiology. , 1997, Academic radiology.

[96]  G. Rosenthal,et al.  Patient assessments of hospital maternity care: a useful tool for consumers? , 1999, Health services research.

[97]  William R. Koch,et al.  A Facet Analysis Approach to Content and Construct Validity , 1993 .

[98]  T Klose,et al.  The contingent valuation method in health care. , 1999, Health policy.

[99]  M. Johannesson,et al.  Economic evaluation of lipid lowering--a feasibility test of the contingent valuation approach. , 1992, Health policy.

[100]  A Laupacis,et al.  The effect of elective total hip replacement on health-related quality of life. , 1993, The Journal of bone and joint surgery. American volume.

[101]  Anselm L. Strauss,et al.  Qualitative Analysis For Social Scientists , 1987 .

[102]  D. Wittink,et al.  Commercial Use of Conjoint Analysis: A Survey , 1982 .

[103]  D M Southern,et al.  The concept mapping method. An alternative to focus group inquiry in general practice. , 1999, Australian family physician.

[104]  T. Klassen,et al.  Economic comparison of a tissue adhesive and suturing in the repair of pediatric facial lacerations. , 1995, The Journal of pediatrics.

[105]  A. O'Connor Validation of a Decisional Conflict Scale , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[106]  R. Kane,et al.  Methodology for measuring health-state preferences--II: Scaling methods. , 1989, Journal of clinical epidemiology.

[107]  A. Bowling Health care rationing: the public's debate , 1996, BMJ.

[108]  J. Harrington,et al.  Research priorities in occupational medicine: a survey of United Kingdom medical opinion by the Delphi technique. , 1994, Occupational and environmental medicine.

[109]  J. Richardson,et al.  A cost utility analysis of mammography screening in Australia. , 1992, Social science & medicine.

[110]  J. Knetsch The Endowment Effect and Evidence of Nonreversible Indifference Curves. , 1989 .

[111]  Amiram Gafni,et al.  When Do the "Dollars" Make Sense? , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[112]  A. Verbeek,et al.  The feasibility of additive conjoint measurement in measuring utilities in breast cancer patients , 1991 .

[113]  J L Bootman,et al.  Physician prescribing decisions: the effects of situational involvement and task complexity on information acquisition and decision making. , 1993, Social science & medicine.

[114]  D. Tritchler,et al.  Measuring satisfaction with health care: a comparison of single with paired rating strategies. , 1989, Social science & medicine.

[115]  D C Hadorn,et al.  The New Zealand priority criteria project. Part 1: Overview , 1997, BMJ.

[116]  A. Muller,et al.  Willingness to pay for reduction in fatality risk: an exploratory survey. , 1984, American journal of public health.

[117]  John P. Hoehn,et al.  Valuing the Multidimensional Impacts of Environmental Policy: Theory and Methods , 1991 .

[118]  A. Detsky,et al.  Preferences for home vs hospital care among low-risk patients with community-acquired pneumonia. , 1996, Archives of internal medicine.

[119]  R. Roberts,et al.  Relationship of service satisfaction to life satisfaction and perceived well-being. , 1983, Evaluation and program planning.

[120]  D A Redelmeier,et al.  Time Preference in Medical Decision Making and Cost - Effectiveness Analysis , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[121]  R. Spoth,et al.  Identifying Program Preferences through Conjoint Analysis: Illustrative Results from a Parent Sample , 1993, American journal of health promotion : AJHP.

[122]  M. Sanner A comparison of public attitudes toward autopsy, organ donation, and anatomic dissection. A Swedish survey. , 1994, JAMA.

[123]  N. Lurie,et al.  Are all health plans created equal? The physician's view. , 1997, JAMA.

[124]  P. Brink On reliability and validity in qualitative research. , 1987, Western journal of nursing research.

[125]  N. Blaikie A critique of the use of triangulation in social research , 1991 .

[126]  Robin Gregory,et al.  Valuing environmental resources: A constructive approach , 1993 .

[127]  P. Cleary,et al.  The effect of patients' preferences on racial differences in access to renal transplantation. , 1999, The New England journal of medicine.

[128]  A. Hinshaw,et al.  A Patient Satisfaction Instrument: Precision by Replication , 1982, Nursing research.

[129]  N. Lackey,et al.  Needs of caregivers of clinic and hospice cancer patients. , 1996, Cancer nursing.

[130]  Richard Smith,et al.  Keeping the customer satisfied: issues in the interpretation and use of patient satisfaction surveys. , 1994, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[131]  M. Buxton,et al.  Magnetic resonance imaging for the investigation of knee injuries: an investigation of preferences. , 1998, Health economics.

[132]  C. Bamford,et al.  Development of patient satisfaction questionnaires: I. Methodological issues. , 1992, Quality in health care : QHC.

[133]  William Samuelson,et al.  Status quo bias in decision making , 1988 .

[134]  J G Dolan Can decision analysis adequately represent clinical problems? , 1990, Journal of clinical epidemiology.

[135]  E. Lacey,et al.  Assessing beliefs about and needs of senior citizens using the focus group interview: a qualitative approach. , 1987, Health education.

[136]  T. L. Saaty A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[137]  M. Johannesson,et al.  Relationship between quality of life instruments, health state utilities, and willingness to pay in patients with asthma. , 1998, Annals of allergy, asthma & immunology : official publication of the American College of Allergy, Asthma, & Immunology.

[138]  C. Webb,et al.  The Delphi technique: a methodological discussion. , 1994, Journal of advanced nursing.

[139]  J. O. McClain,et al.  Trade-offs and conflicts in evaluation of health system alternatives: methodology for analysis. , 1974, Health services research.

[140]  M. Gallagher,et al.  Policy priorities in diabetes care: a Delphi study. , 1996, Quality in health care : QHC.

[141]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[142]  A. Soliman Assessing the quality of health care: a consumerist approach. , 1993, Health marketing quarterly.

[143]  E J Lusk,et al.  Analysis of Hospital Capital Decision Alternatives: A Priority Assignment Model , 1979, The Journal of the Operational Research Society.

[144]  G. Kobelt Economic considerations and outcome measurement in urge incontinence. , 1997, Urology.

[145]  S. Lahti,et al.  Comparison of ideal and actual behavior of patients and dentists during dental treatment. , 1995, Community dentistry and oral epidemiology.

[146]  T. Kalman An overview of patient satisfaction with psychiatric treatment. , 1983, Hospital & community psychiatry.

[147]  William F. McGhan,et al.  Using Conjoint Analysis to Evaluate Health State Preferences , 1999 .

[148]  J. Ware,et al.  How to Survey Patient Satisfaction , 1981, Drug intelligence & clinical pharmacy.

[149]  A. Tomes,et al.  Service quality in hospital care: the development of an in-patient questionnaire. , 1995, International journal of health care quality assurance.

[150]  R. Javalgi,et al.  Choosing a hospital: analysis of consumer tradeoffs. , 1991, Journal of health care marketing.

[151]  G. Dupuis,et al.  Measurement of patient satisfaction. , 1999, Anesthesia and analgesia.

[152]  J. Knetsch,et al.  Willingness to Pay and Compensation Demanded: Experimental Evidence of an Unexpected Disparity in Measures of Value , 1984 .

[153]  F. Sturmans,et al.  Self-rated health and mortality in a Lithuanian and a Dutch population. , 1996, Social science & medicine.

[154]  Attitudes toward Age-Based Health Care Rationing , 1995, Journal of aging and health.

[155]  V. Srinivasan,et al.  A Consumer Preference Approach to the Planning of Rural Primary Health-Care Facilities , 1976, Oper. Res..

[156]  E. Kevin Kelloway,et al.  Members' participation in local union activities: measurement, prediction, and replication , 1993 .

[157]  D Camilleri,et al.  Comparing public and private hospital care service quality. , 1998, International journal of health care quality assurance incorporating Leadership in health services.

[158]  M. Carey,et al.  Enhancement of Validity Through Qualitative Approaches , 1992, Evaluation & the health professions.

[159]  T. Greenhalgh How to Read a Paper: The Basics of Evidence-Based Medicine , 1997 .

[160]  Kweku-Muata Osei-Bryson,et al.  Generating Belief Functions from Qualitative Preferences: An Approach to Eliciting Expert Judgments and Deriving Probability Functions , 1998, Data Knowl. Eng..

[161]  Thomas L. Saaty,et al.  Optimum Determination of Hospital Requirements , 1982 .

[162]  B. New,et al.  Rationing in the NHS: principles and pragmatism , 1996 .

[163]  B. Crabtree,et al.  A qualitative approach to primary care research: the long interview. , 1991, Family medicine.

[164]  M Ryan,et al.  Using conjoint analysis to assess women's preferences for miscarriage management. , 1997, Health economics.

[165]  K. Lancaster,et al.  Consumer Demand. A New Approach. , 1972 .

[166]  M. Johannesson,et al.  Economic Evaluation of Hypertension Treatment , 1992, International Journal of Technology Assessment in Health Care.

[167]  G. Torrance,et al.  The utility of different health states as perceived by the general public. , 1978, Journal of chronic diseases.

[168]  D. Spiegelhalter,et al.  Consensus development methods, and their use in clinical guideline development. , 1998, Health technology assessment.

[169]  L. Robin Keller,et al.  Measuring Heart Patients' Willingness to Pay for Changes in Angina Symptoms , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[170]  A. Stiggelbout,et al.  Explaining Distortions in Utility Elicitation through the Rank-dependent Model for Risky Choices , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[171]  Hans-Jörg Seiler Review of “Planning Cells:” Problems of Legitimation , 1995 .

[172]  G. Bonsel,et al.  The comparability and reliability of five health-state valuation methods. , 1997, Social science & medicine.

[173]  M. Johannesson,et al.  Willingness to Pay for Reductions in Angina Pectoris Attacks , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[174]  M. Truchon,et al.  A Borda Measure for Social Choice Functions , 1997 .

[175]  M Johannesson,et al.  Value for money? A contingent valuation study of the optimal size of the Swedish health care budget. , 1995, Health policy.

[176]  Julie Ratcliffe,et al.  Some issues in the application of closed-ended willingness to pay studies to valuing health goods: an application to antenatal care in Scotland , 2000 .

[177]  Timothy O'Riordan,et al.  Progress in Resource Management and Environmental Planning , 1979 .

[178]  M. Venkataramanan,et al.  A technique using analytical hierarchy process in multiobjective planning models , 1986 .

[179]  L. S. Ganesh,et al.  A simulation-based evaluation of the approximate and the exact eigenvector methods employed in AHP , 1996 .

[180]  R. D. Smith,et al.  Is Regret Theory an alternative basis for estimating the value of healthcare interventions? , 1996, Health policy.

[181]  Russell L. Ackoff,et al.  An Approximate Measure of Value , 1954, Oper. Res..

[182]  M. Garraway,et al.  Can different patient satisfaction survey methods yield consistent results? Comparison of three surveys , 1996, BMJ.

[183]  K. Wikblad,et al.  The patient's experience of diabetes and its treatment: construction of an attitude scale by a semantic differential technique. , 1990, Journal of advanced nursing.

[184]  Berend Wierenga,et al.  Hierarchical scaling of marketing decision support systems , 1994, Decis. Support Syst..

[185]  B. Salter,et al.  Patient satisfaction surveys as a market research tool for general practices. , 1994, The British journal of general practice : the journal of the Royal College of General Practitioners.

[186]  R. Strauss,et al.  A new approach to the demand for public goods , 1976 .

[187]  R. Shewchuk,et al.  In Search of Service Quality Measures: Some Questions regarding Psychometric Properties , 1991, Health services management research.

[188]  Jagdip Singh,et al.  Medical decision-making and the patient: understanding preference patterns for growth hormone therapy using conjoint analysis. , 1998, Medical care.

[189]  D. D. Harrison,et al.  An Elucidation of Factors Influencing Physicians' Willingness to Perform Elective Female Sterilization , 1988, Obstetrics and gynecology.

[190]  M. Rosén,et al.  Determinants of willingness to pay taxes for a community-based prevention programme , 1997, Scandinavian journal of social medicine.

[191]  D. Armstrong,et al.  Patients' views of priority setting in health care: an interview survey in one practice , 1995, BMJ.

[192]  S. van der Linden,et al.  Feasibility of utility assessment by rating scale and standard gamble in patients with ankylosing spondylitis or fibromyalgia. , 1994, The Journal of rheumatology.

[193]  R. Roberts,et al.  Comparison of indirect and direct approaches to measuring patient satisfaction. , 1983, Evaluation and program planning.

[194]  C. Garbacz,et al.  An Experiment in Valuing Senior Companion Program Services , 1983 .

[195]  T. Bovaird,et al.  Health care quality in NHS hospitals. , 1996, International journal of health care quality assurance.

[196]  A. Woolcock,et al.  A scale for the measurement of quality of life in adults with asthma. , 1992, Journal of clinical epidemiology.

[197]  G. Koocher,et al.  Community consultation in socially sensitive research. Lessons from clinical trials of treatments for AIDS. , 1988, The American psychologist.

[198]  R. Cookson,et al.  Incorporating psycho-social considerations into health valuation: an experimental study. , 2000, Journal of health economics.

[199]  M Ryan,et al.  Response-ordering effects: a methodological issue in conjoint analysis. , 1999, Health economics.

[200]  Luis G. Vargas,et al.  The theory of ratio scale estimation: Saaty's analytic hierarchy process , 1987 .

[201]  M. Johannesson,et al.  The impact of hormone replacement therapy on quality of life and willingness to pay , 1997, British journal of obstetrics and gynaecology.

[202]  A. Montgomery,et al.  The influence of demographic characteristics, menopausal status, and symptoms on women's attitudes toward menopause. , 1995, Women & health.

[203]  Robert Sugden,et al.  Disappointment and Dynamic Consistency in Choice under Uncertainty , 1986 .

[204]  Sanford V. Berg,et al.  Distributional analysis of regional benefits and cost of air quality control , 1979 .

[205]  E A Anderson,et al.  Measuring service quality at a university health clinic. , 1995, International journal of health care quality assurance.

[206]  C. Donaldson,et al.  Willingness to pay: a method for measuring preferences for maternity care? , 1998, Birth.

[207]  M. Gallagher,et al.  Diabetes care: who are the experts? , 1992, Quality in health care : QHC.

[208]  D A Bloch,et al.  Minimum Data Needed on Patient Preferences for Accurate, Efficient Medical Decision Making , 1995, Medical care.

[209]  B. Broadbent Open to question. , 1998, The Health service journal.

[210]  D S Pathak,et al.  Segmenting the antihistamine market: an investigation of consumer preferences. , 1990, Journal of health care marketing.

[211]  Detlof von Winterfeldt,et al.  Additivity and expected utility in risky multiattribute preferences , 1980 .

[212]  B. O'brien,et al.  Valuing outcomes in health care: a comparison of willingness to pay and quality-adjusted life-years. , 1998, Journal of clinical epidemiology.

[213]  D. Fairclough,et al.  Comparison of Time-tradeoff Utilities and Rating Scale Values of Cancer Patients and Their Relatives , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[214]  M. Johannesson,et al.  Patients' willingness to pay for autologous blood donation. , 1997, Health policy.

[215]  G. C. Morrison,et al.  Willingness to pay and willingness to accept: some evidence of an endowment effect , 1997 .

[216]  M. Johannesson,et al.  Willingness to pay for antihypertensive therapy--further results. , 1993, Journal of health economics.

[217]  J. Benbassat,et al.  Patients' preferences for participation in clinical decision making: a review of published surveys. , 1998, Behavioral medicine.

[218]  Frank A. Sloan,et al.  Valuing health care : costs, benefits, and effectiveness of pharmaceuticals and other medical technologies , 1995 .

[219]  A. Elkind,et al.  Made to measure survey. , 1990, The Health service journal.

[220]  S. Lahti,et al.  Dentist and patient opinions about the ideal dentist and patient--developing a compact questionnaire. , 1992, Community dentistry and oral epidemiology.

[221]  R M Kaplan,et al.  Health Status Index: Category Rating versus Magnitude Estimation for Measuring Levels of Well-Being , 1979, Medical care.

[222]  R. Misra,et al.  Cancer detection: how effective is public education? , 1996, Cancer nursing.

[223]  J. A. Sinden,et al.  The Persistence of Evaluation Disparities , 1987 .

[224]  T. Saaty Axiomatic foundation of the analytic hierarchy process , 1986 .

[225]  The health of their nation: how would citizens develop England's health strategy? , 1999, The British journal of general practice : the journal of the Royal College of General Practitioners.

[226]  K. Stronks,et al.  Who should decide? Qualitative analysis of panel data from public, patients, healthcare professionals, and insurers on priorities in health care , 1997, BMJ.

[227]  D. Whynes,et al.  Willingness-to-pay for colorectal cancer screening. , 2001, European journal of cancer.

[228]  T. Tymstra,et al.  Opinions of Dutch physicians, nurses, and citizens on health care policy, rationing, and technology. , 1993, JAMA.

[229]  C Batchelor,et al.  Patient satisfaction studies: methodology, management and consumer evaluation. , 1994, International journal of health care quality assurance.

[230]  Andrew M. Jones,et al.  Limited dependent variables in willingness to pay studies: applications in health care , 1998 .

[231]  M Johannesson,et al.  An Experimental Test of a Theoretical Foundation for Rating-scale Valuations , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[232]  R. Mitchell,et al.  Client Satisfaction with Nursing Services: Evaluation in an Occupational Health Setting , 1999, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[233]  A Maas,et al.  Assessing Utilities by Means of Conjoint Measurement , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[234]  G. Anderson,et al.  Willingness to pay to shorten waiting time for cataract surgery. , 1997, Health affairs.

[235]  Alison Clements,et al.  Qualitative methods in psychology: A research guide , 1995 .

[236]  A. Parducci Chapter 5 – CONTEXTUAL EFFECTS: A RANGE–FREQUENCY ANALYSIS* , 1974 .

[237]  Alice A. Ketchand,et al.  Examining the Role of Service Quality in Overall Service Satisfaction , 1998 .

[238]  P. Stevens Focus groups: collecting aggregate-level data to understand community health phenomena. , 1996, Public health nursing.

[239]  Wales.,et al.  First class delivery : a national survey of women's views of maternity care /Jo Garcia, et al. , 1998 .

[240]  C. O'boyle,et al.  Conceptual approaches to the assessment of quality of life , 1997 .

[241]  R. P. Mohanty,et al.  Use of the Analytic Hierarchy Process for Selecting Automated Manufacturing Systems , 1993 .

[242]  H. McGee,et al.  Individual quality of life in patients undergoing hip replacement , 1992, The Lancet.

[243]  Boris Odynocki The forward and backward processes in health policy planning , 1983 .

[244]  S. Szeinbach,et al.  Variables affecting pharmacists' willingness to accept third-party prescription contracts: a conjoint analysis. , 1990, Journal of health care marketing.

[245]  A Gafni,et al.  Healthy-years Equivalents versus Quality-adjusted Life Years , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[246]  M C Weinstein,et al.  The impact of risk information on patients' willingness to pay for autologous blood donation. , 1998, Medical care.

[247]  M. Johannesson,et al.  Contingent valuation with an open-ended follow-up question: a test of scope effects. , 1997, Health economics.

[248]  Marcia B. Cohen,et al.  Breaking the Rules: A Group Work Perspective on Focus Group Research , 1999 .

[249]  P. Dolan,et al.  Valuing health status using VAS and TTO: what lies behind the numbers? , 1997, Social science & medicine.

[250]  P. Shekelle,et al.  Impact of varying panel membership on ratings of appropriateness in consensus panels: a comparison of a multi- and single disciplinary panel. , 1995, Health services research.

[251]  John R. Hauser,et al.  Intensity Measures of Consumer Preference , 1980, Oper. Res..

[252]  Carole B. Burgoyne Distributive justice and rationing in the NHS: framing effects in press coverage of a controversial decision. , 1997, Journal of community & applied social psychology.

[253]  A. Gafni Willingness to pay in the context of an economic evaluation of healthcare programs: theory and practice. , 1997, The American journal of managed care.

[254]  B. McNeil,et al.  Patient satisfaction as an indicator of quality care. , 1988, Inquiry : a journal of medical care organization, provision and financing.

[255]  R. Rosser,et al.  Impact of diagnosis on utilities assigned to states of illness. , 1993, Journal of the Royal Society of Medicine.

[256]  G W Torrance,et al.  Assessing the value of a new pharmaceutical. A feasibility study of contingent valuation in managed care. , 1998, Medical care.

[257]  Healthy debate? : an independent evaluation of citizens' juries in health settings , 1998 .

[258]  P. Shackley,et al.  Using willingness to pay to value close substitutes: carrier screening for cystic fibrosis revisited. , 1997, Health economics.

[259]  H. M. van der Ploeg,et al.  Preconditions for Sensitivity in Measuring Change: Visual Analogue Scales Compared to Rating Scales in a Likert Format , 1995, Psychological reports.

[260]  Per-Olov Johansson,et al.  On the Value of Changes in Life Expectancy: Blips Versus Parametric Changes , 1997 .

[261]  T. Bovaird,et al.  Service quality in NHS hospitals. , 1995, Journal of management in medicine.

[262]  A Gafni,et al.  Willingness-to-pay as a measure of benefits. Relevant questions in the context of public decisionmaking about health care programs. , 1991, Medical care.

[263]  N. Sewell Continuous quality improvement in acute health care: creating a holistic and integrated approach. , 1997, International journal of health care quality assurance incorporating Leadership in health services.

[264]  J. Richardson,et al.  Cost utility analysis: what should be measured? , 1994, Social science & medicine.

[265]  E. Gilson Who shall live? Who shall die? , 1983, Present tense.

[266]  J. Ratcliffe,et al.  Using willingness to pay to value alternative models of antenatal care. , 1997, Social science & medicine.

[267]  S. Madhavan,et al.  Consumers' preference and willingness to pay for pharmacist counselling for non‐prescription medicines , 1994, Journal of clinical pharmacy and therapeutics.

[268]  P. Slovic The Construction of Preference , 1995 .

[269]  J. Duffy,et al.  Cross national study of perceived service quality in long-term care facilities , 1997 .

[270]  Yoram Wind,et al.  Analytical Approach to Marketing Decisions in Health-Care Organizations , 1976, Oper. Res..

[271]  David Price Choices without reasons: citizens' juries and policy evaluation , 2000, Journal of medical ethics.

[272]  B. Hulka,et al.  Scale for the Measurement of “Satisfaction” with Medical Care: Modifications in Content, Format and Scoring , 1974, Medical care.

[273]  J. Bynner,et al.  Self images and smoking behaviour among school boys. , 1969, The British journal of educational psychology.

[274]  R S Wigton,et al.  How Physicians Use Clinical Information in Diagnosing Pulmonary Embolism , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[275]  L. Borgquist,et al.  Willingness to pay for lipid lowering: a health production function approach , 1993 .

[276]  R. Sohier The dyadic interview as a tool for nursing research. , 1995, Applied nursing research : ANR.

[277]  W. Swinyard,et al.  Optimizing the delivery of patient and physician satisfaction: A conjoint analysis approach , 1993, Health care management review.

[278]  R. Tibshirani,et al.  The Measurement of Patients' Values in Medicine , 1982, Medical decision making : an international journal of the Society for Medical Decision Making.

[279]  Peter M. Chisnall,et al.  Questionnaire Design, Interviewing and Attitude Measurement , 1993 .

[280]  S. Macintyre,et al.  What is, must be best: a research note on conservative or deferential responses to antenatal care provision. , 1984, Social science & medicine.

[281]  H. Sintonen An approach to measuring and valuing health states. , 1981, Social science & medicine. Medical economics.

[282]  J. Sinden,et al.  Benefit evaluation of increments to existing systems of public facilities. , 1983 .

[283]  S. Eastaugh Valuation of the Benefits of Risk-free Blood: Willingness to Pay for Hemoglobin Solutions , 1991, International Journal of Technology Assessment in Health Care.

[284]  Andrea Rangone,et al.  An analytical hierarchy process framework for comparing the overall performance of manufacturing departments , 1996 .

[285]  S. Simonian,et al.  Assessing treatment acceptance: the Abbreviated Acceptability Rating Profile. , 1992, Journal of behavior therapy and experimental psychiatry.

[286]  D. Kaldenberg,et al.  Identifying service quality strengths and weaknesses using SERVQUAL: a study of dental services. , 1998, Health marketing quarterly.

[287]  D. Shickle Public preferences for health care: prioritisation in the United Kingdom. , 1997, Bioethics.

[288]  J E Ware,et al.  Methods For Measuring Patient Satisfaction With Specific Medical Encounters , 1988, Medical care.

[289]  A. Mills,et al.  Financing mechanisms for village activities in The Gambia and their implications for financing insecticide for bednet impregnation. , 1994, The Journal of tropical medicine and hygiene.

[290]  S. Birdwell,et al.  Identifying health care needs of rural Ohio citizens: an evaluation of a two-stage methodology. , 1996, The Journal of rural health : official journal of the American Rural Health Association and the National Rural Health Care Association.

[291]  J. Charlton,et al.  Spending priorities in Kent: a Delphi study. , 1981, Journal of epidemiology and community health.

[292]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[293]  D. Shemwell,et al.  Congregate care facility selection: a conjoint approach. , 1997, Health marketing quarterly.

[294]  A Davis,et al.  Critical factors in the determination of focus group size. , 1995, Family practice.

[295]  D. Healy,et al.  The meaning of patient satisfaction: an explanation of high reported levels. , 1998, Social science & medicine.

[296]  E. Murphy,et al.  Qualitative research methods in health technology assessment: a review of the literature. , 1998, Health technology assessment.

[297]  J G Dolan,et al.  Using the analytic hierarchy process (AHP) to develop and disseminate guidelines. , 1992, QRB. Quality review bulletin.

[298]  R. Endacott,et al.  Can the needs of the critically ill child be identified using scenarios? Experiences of a modified Delphi study. , 1999, Journal of advanced nursing.

[299]  M. Johannesson,et al.  Outcome measurement in economic evaluation. , 1996, Health economics.

[300]  O. Ryynänen,et al.  Random paired scenarios--a method for investigating attitudes to prioritisation in medicine. , 1996, Journal of medical ethics.

[301]  M. Gómez-Beneyto,et al.  Relationship between family attitudes measured by the Semantic Differential and relapse in schizophrenia: a 2 year follow-up prospective study , 1995, Psychological Medicine.

[302]  L. Beach,et al.  Do ranks suffice? A comparison of alternative weighting approaches in value elicitation , 1995 .

[303]  L. Podell,et al.  A Guttman scale for sexual experience; a methodological note. , 1957, Journal of Abnormal Psychology.

[304]  A. Tversky,et al.  On the elicitation of preferences for alternative therapies. , 1982, The New England journal of medicine.

[305]  D. Razavi,et al.  A comprehensive assessment of satisfaction with care for cancer patients , 1998, Supportive Care in Cancer.

[306]  K C Cain,et al.  Measuring Preferences for Health States Worse than Death , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[307]  P. Dolan,et al.  Inconsistency and health state valuations. , 1996, Social science & medicine.

[308]  W. Mangold,et al.  Adapting the SERVQUAL scale to hospital services: an empirical investigation. , 1992, Health services research.

[309]  E L Hannan,et al.  A priority assignment model for standards and conditions in a long term care survey. , 1981, Socio-economic planning sciences.

[310]  J. Payne,et al.  How People Respond to Contingent Valuation Questions: A Verbal Protocol Analysis of Willingness to Pay for an Environmental Regulation , 1994 .

[311]  M. Ryan Should government fund assisted reproductive techniques? A study using willingness to pay , 1997 .

[312]  D K Owens,et al.  The effect of stroke and stroke prophylaxis with aspirin or warfarin on quality of life. , 1996, Archives of internal medicine.

[313]  Z Hakim,et al.  Modelling the EuroQol data: a comparison of discrete choice conjoint and conditional preference modelling. , 1999, Health economics.

[314]  H. Luft,et al.  Willingness to pay for poison control centers. , 1997, Journal of health economics.

[315]  V. Chinburapa,et al.  Predicting Prescribing Intention and Assessing Drug Attribute Importance Using Conjoint Analysis , 1988 .

[316]  Muhammad Hanif,et al.  Satisfaction with health care among primary health care centers attendees' in Al-Khobar, Saudi Arabia , 1997 .

[317]  W M Tierney,et al.  Can raters consistently evaluate the content of focus groups? , 1998, Social science & medicine.

[318]  M. Ryan,et al.  Using discrete choice modelling in priority setting: an application to clinical service developments. , 2000, Social science & medicine.

[319]  G Chakraborty,et al.  How consumers choose health insurance. , 1994, Journal of health care marketing.

[320]  D M Trandel-Korenchuk,et al.  Patient participation in decision making. , 1982, The Nurse practitioner.

[321]  D. E. Turner,et al.  Quality determinants and hospital satisfaction. Perceptions of the facility and staff might be key influencing factors. , 1998, Marketing health services.

[322]  D. E. Headley,et al.  Measuring service quality and its relationship to future consumer behavior. , 1993, Journal of health care marketing.

[323]  M. Johannesson,et al.  Willingness to pay for antihypertensive therapy--results of a Swedish pilot study. , 1991, Journal of health economics.

[324]  R. Klein,et al.  The Beaver Dam Health Outcomes study , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[325]  David Price Desperately Seeking Solutions: Rationing Health Care , 1999, BMJ.

[326]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[327]  J. McCusker Development of Scales to Measure Satisfaction and Preferences Regarding Long-Term and Terminal Care , 1984, Medical care.

[328]  S. A. Scardina,et al.  SERVQUAL: a tool for evaluating patient satisfaction with nursing care. , 1994, Journal of nursing care quality.

[329]  C Ham,et al.  Priority setting in health care: learning from international experience. , 1997, Health policy.

[330]  F. D. de Charro,et al.  Measuring the quality of life before and after bilateral lung transplantation in patients with cystic fibrosis. , 1994, Chest.

[331]  Sarah Wordsworth,et al.  Sensitivity of Willingness to Pay Estimates to the Level of Attributes in Discrete Choice Experiments , 2000 .

[332]  M. Avis,et al.  Incorporating patients' voices in the audit process. , 1997, Quality in health care : QHC.

[333]  R. Bourne,et al.  What Is the Best Way of Assessing Outcome After Total Knee Replacement? , 1996, Clinical orthopaedics and related research.

[334]  M. Gallagher,et al.  The nominal group technique: a research tool for general practice? , 1993, Family practice.

[335]  P. Brantley,et al.  The Multidisciplinary Hemodialysis Patient Satisfaction Scale: Reliability, Validity, and scale development , 1997 .

[336]  M Johannesson,et al.  Valuation of health changes with the contingent valuation method: a test of scope and question order effects. , 1996, Health economics.

[337]  B. Westra,et al.  Development of the home care client satisfaction instrument. , 1995, Public health nursing.

[338]  Nils-Olov Stålhammar An Empirical Note on Willingness to Pay and Starting-point Bias , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[339]  B. Checkoway Public participation in health planning agencies: promise and practice. , 1982, Journal of health politics, policy and law.

[340]  A. Cartwright The dignity of labour?: A study of childbearing and induction , 1981 .

[341]  D. Morgan Focus groups for qualitative research. , 1988, Hospital guest relations report.

[342]  J. Bertrand,et al.  The Comparability of Focus Group and Survey Results , 1991 .

[343]  L. Chiu Family caregiver's satisfaction with home care in the Taipei metropolitan area. , 1997, Public health nursing.

[344]  Peter Conrad,et al.  Computers and qualitative data: Editor's introductory essay , 1984 .

[345]  E. Nord,et al.  The validity of a visual analogue scale in determining social utility weights for health states. , 1991, The International journal of health planning and management.

[346]  J. Baron,et al.  Confusion of Relative and Absolute Risk in Valuation , 1997 .

[347]  G. Torrance,et al.  Measurement of quality of life in end-stage renal disease: the time trade-off approach. , 1987, Clinical and investigative medicine. Medecine clinique et experimentale.

[348]  A Gafni,et al.  The standard gamble method: what is being measured and how it is interpreted. , 1994, Health services research.

[349]  D. Riccardi,et al.  Use of SERVQUAL to assess Clinicians' Satisfaction with the Blood Transfusion Service , 1997, Vox sanguinis.

[350]  D. Ruta,et al.  Measurement of quality of life in atopic dermatitis: correlation and validation of two different methods , 1997, The British journal of dermatology.

[351]  David E. Bell,et al.  Disappointment in Decision Making Under Uncertainty , 1985, Oper. Res..

[352]  S. Gabbe,et al.  Decision Analysis of High-Risk Patient Referral , 1984, Obstetrics and gynecology.

[353]  John Brazier,et al.  A review of the use of health status measures in economic evaluation. , 1999, Health technology assessment.

[354]  Babu Joseph,et al.  Decision-making in chemical engineering and expert systems: application of the analytic hierarchy process to reactor selection , 1992 .

[355]  A. Finset,et al.  A new measure of patient satisfaction with mammography. Validation by factor analytic technique. , 1996, Family practice.

[356]  C. Donaldson,et al.  Helicopters, hearts and hips: using willingness to pay to set priorities for public sector health care programmes. , 1998, Social science & medicine.

[357]  T. Clark Community Social Indicators: From Analytical Models to Policy Applications , 1973 .

[358]  D Brannon,et al.  Discriminant analysis: a technique for adding value to patient satisfaction surveys. , 1996, Hospital & health services administration.

[359]  Shmuel Nitzan,et al.  The vulnerability of point-voting schemes to preference variation and strategic manipulation , 1985 .

[360]  Robert Sugden,et al.  The Importance of What Might Have Been , 1984 .

[361]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[362]  V. Wood,et al.  Consumers' satisfaction with health care delivery: issues of measurement, issues of research design. , 1991, Journal of ambulatory care marketing.

[363]  M S Thompson,et al.  Willingness to pay and accept risks to cure chronic disease. , 1986, American journal of public health.

[364]  B. Fischhoff,et al.  Value elicitation: Is there anything in there? , 1991 .

[365]  W. Bunch,et al.  Patient preferences in surgery for scoliosis. , 1985, The Journal of bone and joint surgery. American volume.

[366]  William M. K. Trochim,et al.  Conceptualization for Planning and Evaluation , 2022 .

[367]  R. Thaler Toward a positive theory of consumer choice , 1980 .

[368]  G Bury,et al.  A new short form individual quality of life measure (SEIQoL-DW): application in a cohort of individuals with HIV/AIDS , 1996, BMJ.

[369]  C Ham,et al.  Priority setting in the NHS: reports from six districts. , 1993, BMJ.

[370]  S. Becker,et al.  Assessment of the combined orthodontic-surgical treatment from the patients' point of view. A longitudinal study. , 1996, Journal of orofacial orthopedics = Fortschritte der Kieferorthopadie : Organ/official journal Deutsche Gesellschaft fur Kieferorthopadie.

[371]  R. Harwood,et al.  Measuring handicap: the London Handicap Scale, a new outcome measure for chronic disease. , 1994, Quality in health care : QHC.

[372]  A. Parry Handbook of Qualitative Research , 2002 .

[373]  G. C. Morrison,et al.  Appraising the use of contingent valuation. , 1992, Health economics.

[374]  J. Cairns,et al.  Evaluating the benefits of antenatal screening: an alternative approach. , 1996, Health policy.

[375]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[376]  G W Torrance,et al.  Utility approach to measuring health-related quality of life. , 1987, Journal of chronic diseases.

[377]  P. Glasner,et al.  Empowering the public? Citizens' juries and the new genetic technologies , 1998 .

[378]  R. Hays,et al.  Improving task comprehension in the measurement of health state preferences. A trial of informational cartoon figures and a paired-comparison task. , 1992, Journal of clinical epidemiology.

[379]  A Gafni,et al.  Health care contingent valuation studies: a review and classification of the literature. , 1998, Health economics.

[380]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[381]  J. Read,et al.  Feasibility of Willingness-to-Pay Measurement in Chronic Arthritis , 1984, Medical decision making.

[382]  P. Dolan,et al.  The time trade-off method: results from a general population study. , 1996, Health economics.

[383]  M. Ryan,et al.  The veil of experience: do consumers prefer what they know best? , 2000, Health economics.

[384]  M H Eckman A Counterpoint to the Analytic Hierarchy Process , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[385]  B. Williams Patient satisfaction: a valid concept? , 1994, Social science & medicine.

[386]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[387]  L. Nilsson,et al.  Couples' willingness to pay for IVF/ET , 1995, Acta obstetricia et gynecologica Scandinavica.

[388]  Richard Cookson,et al.  Effect of discussion and deliberation on the public's views of priority setting in health care: focus group study , 1999, BMJ.

[389]  D. Mishra,et al.  An empirical investigation of two competing models of patient satisfaction. , 1991, Journal of ambulatory care marketing.

[390]  P. Dolan,et al.  Valuing health states: a comparison of methods. , 1996, Journal of health economics.

[391]  J. Lenaghan,et al.  Involving the public in rationing decisions. The experience of citizens juries. , 1999, Health policy.

[392]  R. Luce,et al.  Simultaneous conjoint measurement: A new type of fundamental measurement , 1964 .

[393]  W. Sykes,et al.  Consulting the public about health service priorities , 1995, BMJ.

[394]  Kristen Purcell,et al.  Public Participation and the Environment: Do We Know What Works? , 1999 .

[395]  A. Ramirez,et al.  The use of focus groups in health research. , 1988, Scandinavian journal of primary health care. Supplement.

[396]  D. Eddy What's Going on in Oregon? , 1991 .

[397]  G. Kobelt-Nguyen,et al.  Willingness to pay for reduced incontinence symptoms. , 1997, British journal of urology.

[398]  P. Shekelle,et al.  The effect of panel membership and feedback on ratings in a two-round Delphi survey: results of a randomized controlled trial. , 1999, Medical care.

[399]  Robert Dingwall,et al.  Catching Goldfish: Quality in Qualitative Research , 1998, Journal of health services research & policy.

[400]  M. Weinstein,et al.  What Do Patients Value?: Willingness to Pay for Ultrasound in Normal Pregnancy , 1985, Medical care.

[401]  M. Zeidner,et al.  Reduction of test anxiety: A first attempt at economic evaluation , 1994 .

[402]  F. Eckel Rationing America’s Medical Care: The Oregon Plan and Beyond , 1993 .

[403]  Magnitude estimation of the utility of public goods. , 1991 .

[404]  T. Heberlein,et al.  Research Report: Do Public Meetings Represent the Public? , 1984 .

[405]  R. Spoth Multi-attribute analysis of benefit managers' preferences for smoking cessation programs. , 1990, Health values.

[406]  C. Propper Contingent Valuation of Time Spent on NHS Waiting Lists , 1990 .

[407]  X. Badia,et al.  Inconsistent responses in three preference-elicitation methods for health states. , 1999, Social science & medicine.

[408]  H. Roberts,et al.  Setting priorities for measures of performance for geriatric medical services. , 1994, Age and ageing.

[409]  P. Norman,et al.  Development of a questionnaire to measure patients' satisfaction with general practitioners' services. , 1995, The British journal of general practice : the journal of the Royal College of General Practitioners.

[410]  E. Nord The trade-off between severity of illness and treatment effect in cost-value analysis of health care. , 1993, Health policy.

[411]  R. Mulye An empirical comparison of three variants of the AHP and two variants of conjoint analysis , 1998 .

[412]  R. P. Mohanty,et al.  Use of Analytic Hierarchic Process for Evaluating Sources of Supply , 1993 .

[413]  J. Secker,et al.  Qualitative methods in health promotion research: some criteria for quality , 1995 .

[414]  S. Lahti,et al.  Opinions of different subgroups of dentists and patients about the ideal dentist and the ideal patient. , 1995, Community dentistry and oral epidemiology.

[415]  T. Rosenthal,et al.  Providing birthing services in rural health networks: coping with change in New York State. , 1996, The Journal of rural health : official journal of the American Rural Health Association and the National Rural Health Care Association.

[416]  Pierre Valois,et al.  The importance of selecting appropriate adjective pairs for measuring attitude based on the semantic differential method , 1991 .

[417]  A. Sargeant,et al.  Factors of patient satisfaction with medical services: the case of G.P. practices in the U.K. , 1998, Health marketing quarterly.

[418]  Vern W. Weekman,et al.  Laboratory reactors and their limitations , 1974 .

[419]  R. Fitzpatrick,et al.  Surveys of patient satisfaction: II--Designing a questionnaire and conducting a survey. , 1991, BMJ.

[420]  J. Fazey,et al.  Self-Esteem, Compliance, and Cervical Screening , 1995, Psychological reports.

[421]  John Rohrbaugh,et al.  Improving the quality of group judgment: Social judgment analysis and the nominal group technique , 1981 .

[422]  J. Kitzhaber Prioritising health services in an era of limits: the Oregon experience. , 1993, BMJ.

[423]  N. Anderson Integration theory and attitude change. , 1971 .

[424]  N. Anderson Functional measurement and psychophysical judgment. , 1970, Psychological review.

[425]  Leslie Lenert,et al.  Willingness-to-pay utility assessment: feasibility of use in normative patient decision support systems , 1997, AMIA.

[426]  Cam Donaldson,et al.  Validity of open-ended and payment scale approaches to eliciting willingness to pay , 1997 .

[427]  B. Psaty,et al.  Willingness to pay for antihypertensive care: evidence from a staff-model HMO. , 1997, Social science & medicine.

[428]  G. Larsson,et al.  Quality of care. Development of a patient-centred questionnaire based on a grounded theory model. , 1994, Scandinavian journal of caring sciences.