A Systematic Review of the Empirical Literature Evaluating IRBs: What We Know and What We Still Need to Learn

Institutional review boards (IRBs) are integral to the U.S. system of protection of human research participants. Evaluation of IRBs, although difficult, is essential. To date, no systematic review of IRB studies has been published. We conducted a systematic review of empirical studies of U.S. IRBs to determine what is known about the function of IRBs and to identify gaps in knowledge. A structured search in PubMed identified forty-three empirical studies evaluating U.S. IRBs. Studies were included if they reported an empirical investigation of the structure, process, outcomes, effectiveness, or variation of U.S. IRBs. The authors reviewed each study to extract information about study objectives, sample and methods, study results, and conclusions. Empirical evidence collected in forty-three published studies shows that for review of a wide range of types of research, U.S. IRBs differ in their application of the federal regulations, in the time they take to review studies, and in the decisions made. Existing studies show evidence of variation in multicenter review, inconsistent or ambiguous interpretation of the federal regulations, and inefficiencies in review. Despite recognition of a need to evaluate effectiveness of IRB review, no identified published study included an evaluation of IRB effectiveness. Multiple studies evaluating the structure, process, and outcome of IRB review in the United States have documented inconsistencies and inefficiencies. Efforts should be made to address these concerns. Additional research is needed to understand how IRBs accomplish their objectives, what issues they find important, what quality IRB review is, and how effective IRBs are at protecting human research participants.

[1]  P. Andreason,et al.  OHRP compliance oversight letters: an update. , 2010, IRB.

[2]  J. Tyson,et al.  Variation among institutional review boards in evaluating the design of a multicenter randomized trial , 2010, Journal of Perinatology.

[3]  C. Roehrborn,et al.  Variation in institutional review board responses to a standard protocol for a multicenter randomized, controlled surgical trial. , 2009, The Journal of urology.

[4]  M. Synofzik,et al.  Systematic reviews of empirical bioethics , 2008, Journal of Medical Ethics.

[5]  Robert J. Volk,et al.  Principal Investigator Views of the IRB System , 2008, International journal of medical sciences.

[6]  C. Coleman,et al.  How do we know that research ethics committees are really working? The neglected role of outcomes assessment in research ethics review , 2008, BMC medical ethics.

[7]  K. Maschke Human Research Protections: Time for Regulatory Reform? , 2008, The Hastings Center report.

[8]  Robert J Levine,et al.  The dysregulation of human subjects research. , 2007, JAMA.

[9]  H. Taylor Moving beyond compliance: measuring ethical quality to enhance the oversight of human subjects research. , 2007, IRB.

[10]  E. Emanuel,et al.  Institutional review board review of multicenter studies. , 2007, Annals of internal medicine.

[11]  K. B. McClure,et al.  A qualitative study of institutional review board members’ experience reviewing research proposals using emergency exception from informed consent , 2007, Journal of Medical Ethics.

[12]  C. Camargo,et al.  Variation in institutional review board responses to a standard, observational, pediatric research protocol. , 2007, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[13]  W. Rothstein,et al.  Ethical attitudes of nurse, physician, and unaffiliated members of institutional review boards. , 2007, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[14]  K. B. McClure,et al.  using emergency exception from informed consent members' experience reviewing research proposals A qualitative study of institutional review board , 2007 .

[15]  E. Campbell,et al.  Financial relationships between institutional review board members and industry. , 2006, The New England journal of medicine.

[16]  J. Donfack,et al.  Unique challenges of obtaining regulatory approval for a multicenter protocol to study the genetics of RRP and suggested remedies , 2006, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[17]  K. Getz,et al.  Variability in the Costs of Institutional Review Board Oversight , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[18]  Sarah M. Greene,et al.  A review finds that multicenter studies face substantial challenges but strategies exist to achieve Institutional Review Board approval. , 2006, Journal of clinical epidemiology.

[19]  E. Anderson A Qualitative Study of Non-Affiliated, Non-Scientist Institutional Review Board Members , 2006, Accountability in research.

[20]  W. Greenough,et al.  Mission Creep in the IRB World , 2006, Science.

[21]  C. Feudtner,et al.  Variation in Standards of Research Compensation and Child Assent Practices: A Comparison of 69 Institutional Review Board–Approved Informed Permission and Assent Forms for 3 Multicenter Pediatric Clinical Trials , 2006, Pediatrics.

[22]  Sarah M. Greene,et al.  Impact of IRB requirements on a multicenter survey of prophylactic mastectomy outcomes. , 2006, Annals of epidemiology.

[23]  J. Lowery,et al.  Impact of institutional review board practice variation on observational health services research. , 2006, Health services research.

[24]  C. Camargo,et al.  Feasibility of a National Fatal Asthma Registry: More Evidence of IRB Variation in Evaluation of a Standard Protocol , 2005, The Journal of asthma : official journal of the Association for the Care of Asthma.

[25]  R. Arnold,et al.  The need to understand IRB deliberations. , 2006, IRB.

[26]  Catarina Kiefe,et al.  Variation in Institutional Review processes for a multisite observational study. , 2005, American journal of surgery.

[27]  Roger T. Anderson,et al.  Variations among Institutional Review Board reviews in a multisite health services research study. , 2005, Health services research.

[28]  C. Grady,et al.  Regional ethics organizations for protection of human research participants , 2004, Nature Medicine.

[29]  Richard Ashcroft,et al.  Research ethics committees: differences and moral judgement. , 2004, Bioethics.

[30]  Elaine Larson,et al.  A survey of IRB process in 68 U.S. hospitals. , 2004, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[31]  C. Grady,et al.  Oversight of Human Participants Research: Identifying Problems To Evaluate Reform Proposals , 2004, Annals of Internal Medicine.

[32]  T. Wagner,et al.  Economies of Scale in Institutional Review Boards , 2004, Medical care.

[33]  K. Bramstedt,et al.  A study of warning letters issued to institutional review boards by the United States Food and Drug Administration. , 2004, Clinical and investigative medicine. Medecine clinique et experimentale.

[34]  R. Meyer,et al.  Medical Schools' Attitudes and Perceptions Regarding the Use of Central Institutional Review Boards , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[35]  Seema K. Shah,et al.  Institutional review board practices regarding assent in pediatric research. , 2004, Pediatrics.

[36]  Seema K. Shah,et al.  How do institutional review boards apply the federal risk and benefit standards for pediatric research? , 2004, JAMA.

[37]  E. Campbell,et al.  Characteristics of Medical School Faculty Members Serving on Institutional Review Boards: Results of a National Survey , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[38]  Ada Hamosh,et al.  Problematic variation in local institutional review of a multicenter genetic epidemiology study. , 2003, JAMA.

[39]  A. Vernon,et al.  The effects of local review on informed consent documents from a multicenter clinical trials consortium. , 2003, Controlled clinical trials.

[40]  T. Wagner,et al.  The Cost of Operating Institutional Review Boards (IRBs) , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[41]  B. Lo,et al.  The Roles and Experiences of Nonaffiliated and Non‐scientist Members of Institutional Review Boards , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[42]  Laura Lyman Rodriguez,et al.  Responsible Research: A Systems Approach to Protecting Research Participants , 2003 .

[43]  E. Rasch,et al.  Variability in institutional review board assessment of minimal-risk research. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[44]  C. Forsberg,et al.  What Do IRBs Look Like? What Kind of Support Do They Receive? , 2002, Accountability in research.

[45]  R. Steinbrook Improving protection for research subjects. , 2002, The New England journal of medicine.

[46]  M. White,et al.  Informed Consent for Research on Stored Blood and Tissue Samples: A Survey of Institutional Review Board Practices , 2002, Accountability in research.

[47]  M. Radeos,et al.  Variation in institutional review board responses to a standard protocol for a multicenter clinical trial. , 2001, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[48]  S. Hull,et al.  Variability among institutional review boards’ decisions within the context of a multicenter trial , 2001, Critical care medicine.

[49]  R. Reves,et al.  Breaking the Camel's Back: Multicenter Clinical Trials and Local Institutional Review Boards , 2001, Annals of Internal Medicine.

[50]  Donald F. Schwartz,et al.  A case study in adolescent participation in clinical research: eleven clinical sites, one common protocol, and eleven IRBs. , 1999, IRB.

[51]  L. White,et al.  Structure and practice of institutional review boards in the United States. , 1996, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[52]  D. Maloney Federal report says protection of human subjects is threatened by numerous factors. , 1996, Human research report.

[53]  H. Vanderpool The ethics of research involving human subjects : facing the 21st century , 1996 .

[54]  S. Hayes,et al.  A survey of university institutional review boards: characteristics, policies, and procedures. , 1995, IRB.

[55]  M. Grodin,et al.  A 12-year audit of IRB decisions. , 1986, QRB. Quality review bulletin.

[56]  J. Goldman,et al.  Inconsistency and IRBs: flaws in the Goldman-Katz study. , 1984, IRB.

[57]  J. Goldman,et al.  Inconsistency and institutional review boards. , 1982, JAMA.

[58]  Henry J. Hyde President's Commission for the Study of Ethical Problems in Medicine and Biomedical and Behavioral Research. , 1978, Congressional record : proceedings and debates of the ... Congress. United States. Congress.

[59]  J. Stryker,et al.  President's Commission for the Study of Ethical Problems in Medicine and Biomedical and Behavioral Research. , 1978, Congressional record : proceedings and debates of the ... Congress. United States. Congress.

[60]  B. Gray An Assessment of Institutional Review Committees in Human Experimentation , 1975, Medical care.

[61]  J. Boss Human guinea pigs , 1974, Nature.