Regulating the Production of Knowledge: Research Risk-Benefit Analysis and the Heterogeneity Problem

Scholars and lawmakers expend much effort determining optimal incentives to innovate, but almost entirely neglect the regulation of knowledge-producing activities themselves. This Article critically examines that regulatory framework, adopted by more than one dozen federal agencies in the U.S. and many other countries, which governs the vast majority of those knowledge-producing activities that have the greatest potential to affect human welfare: research involving human beings, or “human subjects research” (HSR). It focuses on the primary actors in the regulation of HSR — licensing committees called Institutional Review Boards (IRBs) which, before each study may proceed, must find that its risks to participants are “reasonable in relation to” its expected benefits for both participants and society. It argues for a particular interpretation of this risk-benefit standard and, drawing on scholarship in psychology, economics, neuroscience and other fields, argues that participant heterogeneity prevents IRBs from carrying out their regulatory duty. Instead, the regulatory system implicitly responds to the heterogeneity problem with risk aversion that is costly not only to researchers and society but, critically, to would-be research participants. The Article concludes by laying out the policy options that remain in the wake of the heterogeneity problem’s intractability: continuing the legal fiction of risk-benefit analysis, honestly embracing the heterogeneity problem and its costs, or jettisoning IRB risk-benefit analysis. A companion Article develops the possibility of the third option.

[1]  C. Forsberg,et al.  What Do IRBs Look Like? What Kind of Support Do They Receive? , 2002, Accountability in research.

[2]  K. Fulford,et al.  Diversity in the practice of district ethics committees. , 1989, BMJ.

[3]  C. Camargo,et al.  Variation in institutional review board responses to a standard, observational, pediatric research protocol. , 2007, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[4]  S. Hull,et al.  Variability among institutional review boards’ decisions within the context of a multicenter trial , 2001, Critical care medicine.

[5]  C. Hervé,et al.  Analysis of a survey of 36 French research committees on intracytoplasmic sperm injection , 1998, The Lancet.

[6]  M. White,et al.  Informed Consent for Research on Stored Blood and Tissue Samples: A Survey of Institutional Review Board Practices , 2002, Accountability in research.

[7]  Roger T. Anderson,et al.  Variations among Institutional Review Board reviews in a multisite health services research study. , 2005, Health services research.

[8]  P. Fentem,et al.  Local Research Ethics Committees , 1994, Journal of the Royal College of Physicians of London.

[9]  Annette B. Hemmings Great Ethical Divides: Bridging the Gap Between Institutional Review Boards and Researchers , 2006 .

[10]  M. Radeos,et al.  Variation in institutional review board responses to a standard protocol for a multicenter clinical trial. , 2001, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[11]  E. Rasch,et al.  Variability in institutional review board assessment of minimal-risk research. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[12]  B. Mustanski Ethical and Regulatory Issues with Conducting Sexuality Research with LGBT Adolescents: A Call to Action for a Scientifically Informed Approach , 2011, Archives of sexual behavior.

[13]  Ada Hamosh,et al.  Problematic variation in local institutional review of a multicenter genetic epidemiology study. , 2003, JAMA.

[14]  Roger J Lewis,et al.  Institutional variability in a minimal risk, population-based study: recognizing policy barriers to health services research. , 2005, Health services research.

[15]  E. Emanuel,et al.  Quantifying the federal minimal risk standard: implications for pediatric research without a prospect of direct benefit. , 2005, JAMA.

[16]  W. Ross Are ethical committees reliable? , 1995, Journal of the Royal Society of Medicine.

[17]  C. Grady Do IRBs protect human research participants? , 2010, JAMA.

[18]  J. Lowery,et al.  Impact of institutional review board practice variation on observational health services research. , 2006, Health services research.

[19]  Sarah M. Greene,et al.  Impact of IRB requirements on a multicenter survey of prophylactic mastectomy outcomes. , 2006, Annals of epidemiology.

[20]  Canadian research ethics boards, MRI research risks, and MRI risk classification. , 2009, IRB.

[21]  P. Ubel,et al.  Pruning the regulatory tree , 2009, Nature.