Limitations of medical research and evidence at the patient-clinician encounter scale.

We explore some philosophical and scientific underpinnings of clinical research and evidence at the patient-clinician encounter scale. Insufficient evidence and a common failure to use replicable and sound research methods limit us. Both patients and health care may be, in part, complex nonlinear chaotic systems, and predicting their outcomes is a challenge. When trustworthy (credible) evidence is lacking, making correct clinical choices is often a low-probability exercise. Thus, human (clinician) error and consequent injury to patients appear inevitable. Individual clinician decision-makers operate under the philosophical influence of Adam Smith's "invisible hand" with resulting optimism that they will eventually make the right choices and cause health benefits. The presumption of an effective "invisible hand" operating in health-care delivery has supported a model in which individual clinicians struggle to practice medicine, as they see fit based on their own intuitions and preferences (and biases) despite the obvious complexity, errors, noise, and lack of evidence pervading the system. Not surprisingly, the "invisible hand" does not appear to produce the desired community health benefits. Obtaining a benefit at the patient-clinician encounter scale requires human (clinician) behavior modification. We believe that serious rethinking and restructuring of the clinical research and care delivery systems is necessary to assure the profession and the public that we continue to do more good than harm. We need to evaluate whether, and how, detailed decision-support tools may enable reproducible clinician behavior and beneficial use of evidence.

[1]  S. Hulley,et al.  Designing clinical research , 2013 .

[2]  P. Yong,et al.  The Healthcare Imperative: Lowering Costs and Improving Outcomes: Workshop Series Summary , 2013 .

[3]  Steven R. Cummings,et al.  Comprar Designing Clinical Research | Steven R. Cummings | 9781608318049 | Lippincott Williams & Wilkins , 2013 .

[4]  H. Schünemann,et al.  Author's specialty and conflicts of interest contribute to conflicting guidelines for screening mammography. , 2012, Journal of clinical epidemiology.

[5]  E. Kuipers,et al.  Conflicts of Interest Ethics: Silencing Expertise in the Development of International Clinical Practice Guidelines , 2012, Annals of Internal Medicine.

[6]  Invited commentary-Genetic prediction for common diseases. , 2012, Archives of internal medicine.

[7]  John P A Ioannidis,et al.  Reversals of established medical practices: evidence to abandon ship. , 2012, JAMA.

[8]  R. Bartlett,et al.  Contemporary extracorporeal membrane oxygenation for adult respiratory failure: life support in the new era , 2012, Intensive Care Medicine.

[9]  B. Jasny,et al.  Again, and Again, and Again … , 2011 .

[10]  John P A Ioannidis,et al.  Improving Validation Practices in “Omics” Research , 2011, Science.

[11]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[12]  Salomeh Keyhani,et al.  Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study , 2011, BMJ : British Medical Journal.

[13]  J. Ioannidis,et al.  Risk factors and interventions with statistically significant tiny effects. , 2011, International journal of epidemiology.

[14]  John P A Ioannidis,et al.  Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects. , 2011, Journal of clinical epidemiology.

[15]  J. Ioannidis,et al.  Magnitude of effects in clinical trials published in high-impact general medical journals. , 2011, International journal of epidemiology.

[16]  J. Vestbo,et al.  Current controversies and future perspectives in chronic obstructive pulmonary disease. , 2011, American journal of respiratory and critical care medicine.

[17]  John P. A. Ioannidis,et al.  Individualized Cost-Effectiveness Analysis , 2011, PLoS medicine.

[18]  Sharon Begley,et al.  The best medicine. , 2011, Scientific American.

[19]  John P. A. Ioannidis,et al.  An epidemic of false claims. , 2011 .

[20]  John P A Ioannidis,et al.  An epidemic of false claims. Competition and conflicts of interest distort too many medical findings. , 2011, Scientific American.

[21]  D. Kansagara,et al.  Intensive Insulin Therapy in Hospitalized Patients: A Systematic Review , 2011, Annals of Internal Medicine.

[22]  P. Shekelle,et al.  Use of Intensive Insulin Therapy for the Management of Glycemic Control in Hospitalized Patients: A Clinical Practice Guideline From the American College of Physicians , 2011, Annals of Internal Medicine.

[23]  B. Jasny,et al.  Data replication & reproducibility. Again, and again, and again .... Introduction. , 2011, Science.

[24]  D. Kahneman Thinking, Fast and Slow , 2011 .

[25]  David M Kent,et al.  Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal , 2010, Trials.

[26]  Martin Fortin,et al.  Future of Multimorbidity Research: How Should Understanding of Multimorbidity Inform Health System Design? , 2010 .

[27]  J. Gulcher,et al.  Genetic risk information for common diseases may indeed be already useful for prevention and early detection , 2010, European journal of clinical investigation.

[28]  M. Khoury,et al.  Personal genomics: information can be harmful , 2010, European journal of clinical investigation.

[29]  M. Siegel,et al.  Glucose control in the ICU--how tight is too tight? , 2009, The New England journal of medicine.

[30]  John P. A. Ioannidis,et al.  Limits to forecasting in personalized medicine: An overview , 2009 .

[31]  S. Greenfield,et al.  Comparative Effectiveness Research: A Report From the Institute of Medicine , 2009, Annals of Internal Medicine.

[32]  O. Tanner Intensive versus Conventional Glucose Control in Critically Ill Patients , 2009 .

[33]  N. Nayab Kaizen: The key to Japan‚s competitive success , 2009 .

[34]  Rinaldo Bellomo,et al.  Is reducing variability of blood glucose the real but hidden target of intensive insulin therapy? , 2009, Critical care.

[35]  R. Califf,et al.  Scientific evidence underlying the ACC/AHA clinical practice guidelines. , 2009, JAMA.

[36]  H. Warner,et al.  An Electronic Protocol for Translation of Research Results to Clinical Practice: A Preliminary Report , 2008, Journal of diabetes science and technology.

[37]  Renda Soylemez Wiener,et al.  Ill Adults: A Meta-analysis Benefits and Risks of Tight Glucose Control in Critically , 2010 .

[38]  V. Srinivasan Blood glucose variability in critical illness: Is it time to cast a wider net? , 2008, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[39]  Gordon R Bernard,et al.  A replicable method for blood glucose control in critically Ill patients , 2008, Critical care medicine.

[40]  Alan H. Morris,et al.  Multicenter Validation of a Computer-Based Clinical Decision Support Tool for Glucose Control in Adult and Pediatric Intensive Care Units , 2008, Journal of diabetes science and technology.

[41]  B. McNeil,et al.  Knowing What Works in Health Care: A Roadmap for the Nation , 2008 .

[42]  J. Brooks Why most published research findings are false: Ioannidis JP, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece , 2008 .

[43]  J. Howell The world of the market place , 2007, BMJ : British Medical Journal.

[44]  David M Kent,et al.  Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. , 2007, JAMA.

[45]  J. Hodges,et al.  Quality of care for gout in the US needs improvement. , 2007, Arthritis and rheumatism.

[46]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[47]  J. Howell Direct to consumer advertisement: The world of the market place. , 2007, BMJ.

[48]  J. Ioannidis Why Most Published Research Findings Are False , 2005 .

[49]  D. Derauf,et al.  Cognitive psychology of missed diagnoses. , 2005, Annals of internal medicine.

[50]  Douglas G Altman,et al.  Epidemiology and reporting of randomised trials published in PubMed journals , 2005, The Lancet.

[51]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[52]  Donald Berwick,et al.  My Right Knee , 2005, Annals of Internal Medicine.

[53]  Donald A Redelmeier,et al.  Improving patient care. The cognitive psychology of missed diagnoses. , 2005, Annals of internal medicine.

[54]  D. Berwick Improving patient care. My right knee. , 2005, Annals of internal medicine.

[55]  A. Lake Every prescription is a clinical trial , 2004, BMJ : British Medical Journal.

[56]  P. Stow,et al.  How doctors discuss major interventions with high risk patients: an observational study , 2004, BMJ : British Medical Journal.

[57]  S. Senn Individual response to treatment: is it a valid assumption? , 2004, BMJ : British Medical Journal.

[58]  Gideon Koren,et al.  Prospective observational study on the incidence of medication errors during simulated resuscitation in a paediatric emergency department , 2004, BMJ : British Medical Journal.

[59]  Stephen B. Johnson,et al.  Clinical research in the United States at a crossroads: proposal for a novel public-private partnership to establish a national clinical research enterprise. , 2004, JAMA.

[60]  A H Morris,et al.  Iatrogenic illness: a call for decision support tools to reduce unnecessary variation , 2004, Quality and Safety in Health Care.

[61]  Isaac Hoch,et al.  Application of Information Technology: Countrywide Computer Alerts to Community Physicians Improve Potassium Testing in Patients Receiving Diuretics , 2003, J. Am. Medical Informatics Assoc..

[62]  P. Barach,et al.  Patient Safety and the Reliability of Health Care Systems , 2003, Annals of Internal Medicine.

[63]  A. Merry,et al.  Error, Blame, and the Law in Health CareAn Antipodean Perspective , 2003, Annals of Internal Medicine.

[64]  H. Sox Improving Patient Care , 2003, Annals of Internal Medicine.

[65]  David W Bates,et al.  Linking laboratory and pharmacy: opportunities for reducing errors and improving care. , 2003, Archives of internal medicine.

[66]  D. Berwick Disseminating innovations in health care. , 2003, JAMA.

[67]  T. Brennan,et al.  Hospital disclosure practices: results of a national survey. , 2003, Health affairs.

[68]  Vimla L. Patel,et al.  Medical error: is the solution medical or cognitive? , 2002, Journal of the American Medical Informatics Association : JAMIA.

[69]  J. Wennberg,et al.  Unwarranted variations in healthcare delivery: implications for academic medical centres , 2002, BMJ : British Medical Journal.

[70]  D. Bates,et al.  What practices will most improve safety? Evidence-based medicine meets patient safety. , 2002, JAMA.

[71]  A. Morris,et al.  Care A H Morris environments Decision support and safety of clinical , 2002 .

[72]  G. V. Berghe,et al.  Intensive insulin therapy in critically ill patients. , 2001, The New England journal of medicine.

[73]  M Schetz,et al.  Intensive insulin therapy in critically ill patients. , 2001, The New England journal of medicine.

[74]  J M Dean,et al.  Development and impact of a computerized pediatric antiinfective decision support program. , 2001, Pediatrics.

[75]  D A Redelmeier,et al.  Problems for clinical judgement: introducing cognitive psychology as one more basic science. , 2001, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[76]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[77]  M E Hammond,et al.  The challenge of variation in medical practice. , 2009, Archives of pathology & laboratory medicine.

[78]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[79]  J. Reason Human error: models and management , 2000, BMJ : British Medical Journal.

[80]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[81]  Alan H. Morris,et al.  Efficacy of computerized decision support for mechanical ventilation: results of a prospective multi-center randomized trial , 1999, AMIA.

[82]  A. Faden,et al.  [Book review] medical harm, historical, conceptual, and ethical dimensions of iatrogenic illness , 1998 .

[83]  D. Dreyfuss,et al.  Ventilator-induced lung injury: lessons from experimental studies. , 1998, American journal of respiratory and critical care medicine.

[84]  C. Perret,et al.  Intensive care physicians' insufficient knowledge of right-heart catheterization at the bedside: time to act? , 1997, Critical care medicine.

[85]  R W Makuch,et al.  Can treatment that is helpful on average be harmful to some patients? A study of the conflicting information needs of clinical inquiry and drug regulation. , 1996, Journal of clinical epidemiology.

[86]  G. Guyatt,et al.  Stress ulcer prophylaxis in critically ill patients. Resolving discordant meta-analyses. , 1996, JAMA.

[87]  S. Gould Full House: The Spread of Excellence from Plato to Darwin , 1996 .

[88]  D M Rind,et al.  Effects of a knowledge-based electronic patient record in adherence to practice guidelines. , 1996, M.D. computing : computers in medical practice.

[89]  D. Cook,et al.  Corticosteroid treatment for sepsis: a critical appraisal and meta-analysis of the literature. , 1995, Critical care medicine.

[90]  R. Lefering,et al.  Steroid controversy in sepsis and septic shock: a meta-analysis. , 1995, Critical care medicine.

[91]  L. Leape Error in medicine. , 1994, JAMA.

[92]  J. Silverstein,et al.  Assessment of critical care nurses' knowledge of the pulmonary artery catheter , 1994, Critical care medicine.

[93]  D M Berwick,et al.  Eleven worthy aims for clinical leadership of health system reform. , 1994, JAMA.

[94]  R. Haynes,et al.  Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research , 1994, Annals of Internal Medicine.

[95]  W. Silverman Doing More Good Than Harm , 1993, Annals of the New York Academy of Sciences.

[96]  J. Grimshaw,et al.  Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations , 1993, The Lancet.

[97]  W. Shoemaker,et al.  Lack of proof is not proof of a lack: it is the singer, not the song. , 1993, Critical care medicine.

[98]  F. Mosteller,et al.  Reviews and Notes: Policy: Doing More Good Than Harm: The Evaluation of Health Care Interventions , 1993, Annals of Internal Medicine.

[99]  A. Morris Hemodynamic guidelines. , 1993, Critical care medicine.

[100]  W. McIlroy,et al.  Evaluation of right heart catheterization in critically ill patients ONTARIO INTENSIVE CARE STUDY GROUP , 1992, Critical care medicine.

[101]  H L Greene,et al.  The Cardiac Arrhythmia Suppression Trial: first CAST ... then CAST-II. , 1992, Journal of the American College of Cardiology.

[102]  A. Wu,et al.  Do house officers learn from their mistakes?* , 2003, JAMA.

[103]  T. Albertson,et al.  A multicenter study of physicians' knowledge of the pulmonary artery catheter. Pulmonary Artery Catheter Study Group. , 1990, JAMA.

[104]  Daniel Gopher,et al.  The Nature and Causes of Human Errors in a Medical Intensive Care Unit , 1989 .

[105]  W. Rogers,et al.  Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. , 1989, The New England journal of medicine.

[106]  M. Walton The Deming management method , 1986 .

[107]  Ruth Lindquits Frequency of wedge pressure errors in the ICU , 1986 .

[108]  A. Morris Elimination of pulmonary wedge pressure errors commonly encountered in the ICU. , 1985, Cardiologia.

[109]  R. Gardner,et al.  Frequency of technical problems encountered in the measurement of pulmonary artery wedge pressure , 1984, Critical care medicine.

[110]  Teresa M. Amabile,et al.  Judgment under uncertainty: Informal covariation assessment: Data-based versus theory-based judgments , 1982 .

[111]  W. Edwards Deming,et al.  Out of the Crisis , 1982 .

[112]  W. Deming Quality, productivity, and competitive position , 1982 .

[113]  R. Gams,et al.  Do information systems improve the quality of clinical research? Results of a randomized trial in a cooperative multi-institutional cancer group. , 1981, Computers and biomedical research, an international journal.

[114]  S. Cotev,et al.  Adverse occurrences in intensive care units. , 1980, JAMA.

[115]  T. Beauchamp,et al.  Principles of biomedical ethics , 1991 .

[116]  C. McDonald Protocol-based computer reminders, the quality of care and the non-perfectability of man. , 1976, The New England journal of medicine.

[117]  R. Grimm,et al.  Evaluation of patient-care protocol use by various providers. , 1975, The New England journal of medicine.

[118]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[119]  A. Gittelsohn,et al.  Small Area Variations in Health Care Delivery , 1973, Science.

[120]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[121]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[122]  Lotfi A. Zadeh,et al.  General System Theory , 1962 .

[123]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[124]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .