Treatment Effects with Multiple Outcomes

This paper proposes strategies for defining, identifying, and estimating features of treatment-effect distributions in contexts where multiple outcomes are of interest. After describing existing empirical approaches used in such settings, the paper develops a notion of treatment preference that is shown to be a feature of standard treatment-effect analysis in the single-outcome case. Focusing largely on binary outcomes, treatment-preference probability treatment effects (PTEs) are defined and are seen to correspond to familiar average treatment effects in the single-outcome case. The paper suggests seven possible characterizations of treatment preference appropriate to multiple-outcome contexts. Under standard assumptions about unconfoundedness of treatment assignment, the PTEs are shown to be point identified for three of the seven characterizations and set identified for the other four. Probability bounds are derived and empirical approaches to estimating the bounds—or the PTEs themselves in the point-identified cases—are suggested. These empirical approaches are straightforward, involving in most instances little more than estimation of binary-outcome probability models of what are commonly known as composite outcomes. The results are illustrated with simulated data and in analyses of two microdata samples. Finally, the main results are extended to situations where the component outcomes are ordered or categorical.

[1]  C. Whelan,et al.  Using Non-Monetary Deprivation Indicators to Analyze Poverty and Social Exclusion: Lessons from Europe?. , 2010 .

[2]  C. Manski Statistical treatment rules for heterogeneous populations , 2003 .

[3]  John Bound,et al.  "Weathering" and age patterns of allostatic load scores among blacks and whites in the United States. , 2006, American journal of public health.

[4]  R. Cebul,et al.  Electronic health records and quality of diabetes care. , 2011, The New England journal of medicine.

[5]  C. G. Brown,et al.  Moving to Opportunity , 2008 .

[6]  G. Imbens,et al.  Estimating Treatment Effects using Multiple Surrogates: The Role of the Surrogate Score and the Surrogate Index , 2016, 1603.09326.

[7]  H. Comijs,et al.  Physical, lifestyle, psychological, and social determinants of pain intensity, pain disability, and the number of pain locations in depressed older adults , 2014, PAIN®.

[8]  R. D'Agostino,et al.  Multiplicity Considerations in Clinical Trials , 2018, The New England journal of medicine.

[9]  Nish Chaturvedi,et al.  Cardiorenal end points in a trial of aliskiren for type 2 diabetes. , 2012, The New England journal of medicine.

[10]  Greg J Duncan,et al.  Neighborhoods, obesity, and diabetes--a randomized social experiment. , 2011, The New England journal of medicine.

[11]  Lawrence F. Katz,et al.  Long-Term Neighborhood Effects on Low-Income Families: Evidence from Moving to Opportunity , 2013 .

[12]  Teague Ruder,et al.  Multiple Chronic Conditions in the United States , 2017 .

[13]  C. Manski Reasonable patient care under uncertainty. , 2018, Health Economics.

[14]  Susan Athey,et al.  The Econometrics of Randomized Experiments , 2016, 1607.00698.

[15]  D. Rye,et al.  The ICSD-3 and DSM-5 guidelines for diagnosing narcolepsy: clinical relevance and practicality , 2016, Current medical research and opinion.

[16]  J. Lynn,et al.  Value-Based Payments Require Valuing What Matters to Patients. , 2015, JAMA.

[17]  A. Rosen,et al.  Composite Measures of Health Care Provider Performance: A Description of Approaches. , 2015, The Milbank quarterly.

[18]  Lars Lefgren,et al.  Partial Identification of the Distribution of Treatment Effects with an Application to the Knowledge is Power Program (Kipp) , 2018, Quantitative Economics.

[19]  Charles F. Manski,et al.  Confidence Intervals for Partially Identified Parameters , 2003 .

[20]  G. Boole An Investigation of the Laws of Thought: On which are founded the mathematical theories of logic and probabilities , 2007 .

[21]  K. Dodge,et al.  Impact of early intervention on psychopathology, crime, and well-being at age 25. , 2015, The American journal of psychiatry.

[22]  Michael Wolf,et al.  Multiple Testing , 2009 .

[23]  Brendan Mulhern,et al.  Valuing health‐related quality of life: An EQ‐5D‐5L value set for England , 2017, Health economics.

[24]  P. Voisine,et al.  Transcatheter Mitral-Valve Repair in Patients with Heart Failure. , 2019, The New England journal of medicine.

[25]  J. Pell,et al.  Characteristics of rheumatoid arthritis and its association with major comorbid conditions: cross-sectional study of 502 649 UK Biobank participants , 2016, RMD Open.

[26]  H. Minuk,et al.  Metabolic syndrome. , 2005, Journal of insurance medicine.

[27]  Draft Guidance Multiple Endpoints in Clinical Trials Guidance for Industry , 2017 .

[28]  C. Manski,et al.  Monotone Instrumental Variables with an Application to the Returns to Schooling , 1998 .

[29]  R. Conley,et al.  Evaluation of Galcanezumab for the Prevention of Episodic Migraine: The EVOLVE-1 Randomized Clinical Trial , 2018, JAMA neurology.

[30]  F. Wolfe,et al.  The Prevalence and Characteristics of Fibromyalgia in the 2012 National Health Interview Survey , 2015, PloS one.

[31]  N. Khan,et al.  Effect of prescription drug coverage on health of the elderly. , 2008, Health services research.

[32]  Angus G K McNair,et al.  The COMET Handbook: version 1.0 , 2017, Trials.

[33]  Burton H Singer,et al.  Combinations of biomarkers predictive of later life mortality , 2006, Proceedings of the National Academy of Sciences.

[34]  Sokbae Lee,et al.  Intersection bounds: estimation and inference , 2009, 0907.3503.

[35]  J. Angrist,et al.  Two-Stage Least Squares Estimation of Average Causal Effects in Models with Variable Treatment Intensity , 1995 .

[36]  D. Kenkel,et al.  The effect of potential electronic nicotine delivery system regulations on nicotine product selection. , 2016, Addiction.

[37]  John Mullahy,et al.  Individual results may vary: Inequality-probability bounds for some health-outcome treatment effects. , 2018, Journal of health economics.

[38]  C. Manski,et al.  Trial Size for Near-Optimal Choice Between Surveillance and Aggressive Treatment: Reconsidering MSLT-II , 2019, The American Statistician.

[39]  M. Hernán,et al.  Primary Prevention of Cardiovascular Disease with a Mediterranean Diet Supplemented with Extra‐Virgin Olive Oil or Nuts , 2018, The New England journal of medicine.

[40]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[41]  T. Grosser Cardiovascular Safety of Celecoxib, Naproxen, or Ibuprofen for Arthritis. , 2017, The New England journal of medicine.

[42]  R. Färe,et al.  Congestion of Production Factors , 1980 .

[43]  Jennette P. Moreno,et al.  Cardiovascular Effects of Intensive Lifestyle Intervention in Type 2 Diabetes , 2014, Current Atherosclerosis Reports.

[44]  Matias D. Cattaneo,et al.  Econometric Methods for Program Evaluation , 2018, Annual Review of Economics.

[45]  Christian A. Gregory,et al.  Household Food Security in the United States in 2017 , 2018 .

[46]  Jonah E. Rockoff,et al.  What Do Test Scores Miss? The Importance of Teacher Effects on Non–Test Score Outcomes , 2018, Journal of Political Economy.

[47]  S. Alkire,et al.  Counting and Multidimensional Poverty Measurement , 2010 .

[48]  Douglas L. Miller,et al.  Income, the Earned Income Tax Credit, and Infant Health , 2012 .

[49]  E. Hanushek,et al.  ABOUT SCHOOL ACCOUNTABILITY , 2004 .

[50]  W. Gray,et al.  Randomized Trial of Stent versus Surgery for Asymptomatic Carotid Stenosis. , 2016, The New England journal of medicine.