Conceptual model of comprehensive research metrics for improved human health and environment.

Performance measurement predominantly consisted of near-term outputs measured through bibliometrics, but the recent focus is on accountability for investment based on long-term outcomes. Our objective is to build a logic model and associated metrics through which to measure the contribution of environmental health research programs to improvements in human health, the environment, and the economy. We developed a logic model that defines the components and linkages between extramural environmental health research grant programs and the outputs and outcomes related to health and social welfare, environmental quality and sustainability, economics, and quality of life, focusing on the environmental health research portfolio of the National Institute of Environmental Health Sciences (NIEHS) Division of Extramural Research and Training and delineates pathways for contributions by five types of institutional partners in the research process. The model is being applied to specific NIEHS research applications and the broader research community. We briefly discuss two examples and discuss the strengths and limits of outcome- based evaluation of research programs.

[1]  H. Needleman,et al.  The removal of lead from gasoline: historical and personal reflections. , 2000, Environmental research.

[2]  Richard D. Morgenstern,et al.  Reality Check : The Nature and Performance of Voluntary Environmental Programs in the United States, Europe, and Japan , 2007 .

[3]  F. Dominici,et al.  Fine particulate air pollution and hospital admission for cardiovascular and respiratory diseases. , 2006, JAMA.

[4]  Martin J Buxton,et al.  The utilisation of health research in policy-making : concepts , examples and methods of assessment , 2003 .

[5]  Eliezer Geisler,et al.  The Use of Indicators and Measures of the R & D Process in Evaluating Science and Technology Programmes , 1988 .

[6]  A Seaton,et al.  Ambient particle inhalation and the cardiovascular system: potential mechanisms. , 2001, Environmental health perspectives.

[7]  J D Spengler,et al.  Health effects of acid aerosols on North American children: pulmonary function. , 1996, Environmental health perspectives.

[8]  Steve Hanney,et al.  How Can Payback from Health Services Research Be Assessed? , 1996, Journal of health services research & policy.

[9]  John A. McLaughlin,et al.  Logic models: a tool for telling your programs performance story , 1999 .

[10]  S J London,et al.  Air pollution and bronchitic symptoms in Southern California children with asthma. , 1999, Environmental health perspectives.

[11]  D. Brody,et al.  Surveillance for elevated blood lead levels among children--United States, 1997-2001. , 2003, Morbidity and mortality weekly report. Surveillance summaries.

[12]  J L Annest,et al.  Chronological trend in blood lead levels between 1976 and 1980. , 1983, The New England journal of medicine.

[13]  Susan E. Cozzens,et al.  The knowledge pool: Measurement challenges in evaluating fundamental research programs , 1997 .

[14]  Huey-Tsyh Chen,et al.  Practical program evaluation : assessing and improving planning, implementation, and effectiveness , 2005 .

[15]  F. Dominici,et al.  Fine particulate air pollution and mortality in 20 U.S. cities, 1987-1994. , 2000, The New England journal of medicine.

[16]  D. Dockery,et al.  Epidemiologic evidence of cardiovascular effects of particulate air pollution. , 2001, Environmental health perspectives.

[17]  J. Schwartz,et al.  Episodes of high coarse particle concentrations are not associated with increased mortality. , 1999, Environmental health perspectives.

[18]  J. Sarnat,et al.  Fine particulate air pollution and mortality in 20 U.S. cities. , 2001, The New England journal of medicine.

[19]  R. Burnett,et al.  Cardiovascular Mortality and Long-Term Exposure to Particulate Air Pollution: Epidemiological Evidence of General Pathophysiological Pathways of Disease , 2003, Circulation.

[20]  S. Gerking,et al.  Averting Behavior and Urban Air Pollution , 1997 .