Demonstration Projects to Test Built Environment Changes: A Systematic Review

CONTEXT Built environment interventions (pedestrian/bicycle infrastructure and enhanced access) mitigate barriers to physical activity by making the healthy choice the default choice. Demonstration projects (eg, temporary pedestrian lanes or sidewalks marked with tape) are used to test these interventions before making permanent changes. However, it is unknown whether demonstration projects lead to desired built environment changes. OBJECTIVE To systematically review the literature to determine outcomes and overall public health impacts of demonstration projects and whether they lead to permanent changes to the built environment. DESIGN Systematic review, conducted from March to September 2022 by searching PubMed and EBSCOhost for peer-reviewed literature and Google for gray (non-peer-reviewed) literature. Inclusion criteria were policy, systems, or environmental interventions; temporary implementation; and presence of evaluation data. Exclusion criteria were individual/interpersonal-level interventions, permanent implementation, and absence of evaluation data. Two authors coded for inclusion/exclusion and resolved discrepancies, coded a portion of included sources and resolved discrepancies, refined coding guide definitions, and coded remaining sources. MAIN OUTCOME MEASURES Data were extracted based on the expanded RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, which incorporates constructs of the Implementation Outcomes Framework (acceptability, appropriateness, feasibility). RESULTS Gray (N = 23) and peer-reviewed (N = 1) sources describing unique demonstration projects (N = 31) met inclusion criteria. Projects tested built environment interventions including traffic calming measures, crosswalks, bike lanes, intersection design, and trails. Sources primarily reported effectiveness (typically improved safety), maintenance, acceptability, and appropriateness. Most sources did not report projects leading to permanent changes to the built environment. CONCLUSIONS Based on inconsistent reporting of key outcomes (number of community members reached, changes to physical activity levels), overall impacts are unknown. Most demonstration projects captured community members' feedback, which was typically positive, but it is unknown whether feedback led to long-term changes. We recommend providing improved demonstration project guidance for practitioners to facilitate robust data collection, including suggested evaluation methods and tools.

[1]  Laura E. Balis,et al.  Built environment approaches: Extension personnel's preferences, barriers, and facilitators , 2022, Frontiers in Public Health.

[2]  P. McElfish,et al.  Results of a Rural Traffic Calming Event to Promote Physical Activity , 2022, Journal of Extension.

[3]  Laura E. Balis,et al.  Implementation Strategies to Support Built Environment Approaches in Community Settings , 2022, Health promotion practice.

[4]  J. Sallis,et al.  Advocacy to support climate and health policies: recommended actions for the Society of Behavioral Medicine. , 2022, Translational behavioral medicine.

[5]  D. Edmondson,et al.  Climate change, behavior change and health: a multidisciplinary, translational and multilevel perspective. , 2022, Translational behavioral medicine.

[6]  T. Nakaya,et al.  Built environment design and cancer prevention through the lens of inequality , 2021, Cities.

[7]  S. Harden,et al.  Internet Search Results for Older Adult Physical Activity Guidelines: Scoping Review , 2021, JMIR formative research.

[8]  E. Mayo-Wilson,et al.  The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. , 2021, Journal of clinical epidemiology.

[9]  J. Grimshaw,et al.  Designing and undertaking randomised implementation trials: guide for researchers , 2021, BMJ.

[10]  David A. Chambers,et al.  Revisiting time to translation: implementation of evidence-based practices (EBPs) in cancer control , 2021, Cancer Causes and Control.

[11]  R. Gray.  Why do all systematic reviews have fifteen studies? , 2020 .

[12]  Sarah Kennedy,et al.  Comparing, Contrasting, and Integrating Dissemination and Implementation Outcomes Included in the RE-AIM and Implementation Outcomes Frameworks , 2020, Frontiers in Public Health.

[13]  W. Kraus,et al.  Built Environment Approaches to Increase Physical Activity: A Science Advisory From the American Heart Association , 2020, Circulation.

[14]  Jylana L. Sheats,et al.  A Mixed Method Study to Inform the Implementation and Expansion of Pop-Up Parks for Economic, Behavioral, and Social Benefits , 2020, Journal of Urban Health.

[15]  T. O'Toole,et al.  The High Obesity Program: Overview of the Centers for Disease Control and Prevention and Cooperative Extension Services Efforts to Address Obesity , 2020, Preventing chronic disease.

[16]  Scherezade K. Mama,et al.  Rural physical activity interventions in the United States: a systematic review and RE-AIM evaluation , 2019, International Journal of Behavioral Nutrition and Physical Activity.

[17]  Catherine P. Bradshaw,et al.  Scaling up Evidence-Based Interventions in US Public Systems to Prevent Behavioral Health Problems: Challenges and Opportunities , 2019, Prevention Science.

[18]  NithyaPriya S Ramalingam,et al.  Open-Access Physical Activity Programs for Older Adults: A Pragmatic and Systematic Review. , 2019, The Gerontologist.

[19]  L. Minaker,et al.  Is cancer prevention influenced by the built environment? A multidisciplinary scoping review , 2019, Cancer.

[20]  Borsika A. Rabin,et al.  RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review , 2019, Front. Public Health.

[21]  M. R. Umstattd Meyer,et al.  Systematic review of how Play Streets impact opportunities for active play, physical activity, neighborhoods, and communities , 2019, BMC Public Health.

[22]  P. Estabrooks,et al.  Dissemination and Implementation Science for Public Health Professionals: An Overview and Call to Action , 2018, Preventing chronic disease.

[23]  Jo Salmon,et al.  Implementation and scale up of population physical activity interventions for clinical and community settings: the PRACTIS guide , 2018, International Journal of Behavioral Nutrition and Physical Activity.

[24]  Jennifer Leeman,et al.  Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice , 2017, Implementation Science.

[25]  R. Adams,et al.  Shades of Grey: Guidelines for Working with the Grey Literature in Systematic Reviews for Management and Organizational Studies , 2017 .

[26]  A. Fournier,et al.  Association of Leisure-Time Physical Activity With Risk of 26 Types of Cancer in 1.44 Million Adults. , 2016, JAMA internal medicine.

[27]  Ann E. Vandenberg,et al.  Walking and Walkability: Is Wayfinding a Missing Link? Implications for Public Health Practice. , 2016, Journal of physical activity & health.

[28]  R. Glasgow,et al.  Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review , 2015, Systematic Reviews.

[29]  S. Leatherdale,et al.  Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada , 2015, Systematic Reviews.

[30]  P. Estabrooks,et al.  Understanding for whom, under what conditions, and how group-based physical activity interventions are successful: a realist review , 2015, BMC Public Health.

[31]  W. Satariano,et al.  The impact of neighborhood social and built environment factors across the cancer continuum: Current research, methodological considerations, and future directions , 2015, Cancer.

[32]  Jennifer Leeman,et al.  What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective?: a systematic review , 2015, Implementation Science.

[33]  J. Kirchner,et al.  A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project , 2015, Implementation Science.

[34]  Lisa M Klesges,et al.  The 5 R’s: An Emerging Bold Standard for Conducting Relevant Research in a Changing World , 2014, The Annals of Family Medicine.

[35]  Dwayne Van Eerd,et al.  Searching for grey literature for systematic reviews: challenges and benefits , 2014, Research synthesis methods.

[36]  Enola K Proctor,et al.  Implementation strategies: recommendations for specifying and reporting , 2013, Implementation Science.

[37]  R. Glasgow,et al.  The RE-AIM framework: a systematic review of use over time. , 2013, American journal of public health.

[38]  M. McHugh.  Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[39]  David A Chambers,et al.  Bridging research and practice: models for dissemination and implementation research. , 2012, American journal of preventive medicine.

[40]  J. Sallis,et al.  Role of Built Environments in Physical Activity, Obesity, and Cardiovascular Disease , 2012, Circulation.

[41]  S. Wooding,et al.  The answer is 17 years, what is the question: understanding time lags in translational research , 2011, Journal of the Royal Society of Medicine.

[42]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[43]  Borsika A. Rabin,et al.  Dissemination and implementation research on community-based cancer prevention: a systematic review. , 2010, American journal of preventive medicine.

[44]  R. Brownson,et al.  Bridging the gap: translating research into policy and practice. , 2009, Preventive medicine.

[45]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[46]  Ross C Brownson,et al.  A glossary for dissemination and implementation research in health. , 2008, Journal of public health management and practice : JPHMP.

[47]  Lisa M Klesges,et al.  The future of health behavior change research: What is needed to improve translation of research into health promotion practice? , 2004, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[48]  R. Glasgow,et al.  Evaluating the public health impact of health promotion interventions: the RE-AIM framework. , 1999, American journal of public health.