Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments: reliability of alternate methods

BackgroundAn online version of the Microscale Audit of Pedestrian Streetscapes (Abbreviated) tool was adapted to virtually audit built environment features supportive of physical activity. The current study assessed inter-rater reliability of MAPS Online between in-person raters and online raters unfamiliar with the regions.MethodsIn-person and online audits were conducted for a total of 120 quarter-mile routes (60 per site) in Phoenix, AZ and San Diego, CA. Routes in each city included 40 residential origins stratified by walkability and SES, and 20 commercial centers. In-person audits were conducted by raters residing in their region. Online audits were conducted by raters in the alternate location using Google Maps (Aerial and Street View) images. The MAPS Abbreviated Online tool consisted of four sections: overall route, street segments, crossings and cul-de-sacs. Items within each section were grouped into subscales, and inter-rater reliability (ICCs) was assessed for subscales at multiple levels of aggregation.ResultsOnline and in-person audits showed excellent agreement for overall positive microscale (ICC = 0.86, 95% CI [0.80, 0.90]) and grand scores (ICC = 0.93, 95% CI [0.89, 0.95]). Substantial to near-perfect agreement was found for 21 of 30 (70%) subscales, valence, and subsection scores, with ICCs ranging from 0.62, 95% CI [0.50, 0.72] to 0.95, 95% CI [0.93, 0.97]. Lowest agreement was found for the aesthetics and social characteristics scores, with ICCs ranging from 0.07, 95% CI [−0.12, 0.24] to 0.27, 95% CI [0.10, 0.43].ConclusionsResults support use of the MAPS Abbreviated Online tool to reliably assess microscale neighborhood features that support physical activity and may be used by raters residing in different geographic regions and unfamiliar with the audit areas.

[1]  Emily Talen,et al.  Measuring Walkability: A Note on Auditing Methods , 2014 .

[2]  Julien O. Teitler,et al.  Using Google Street View to audit neighborhood environments. , 2011, American journal of preventive medicine.

[3]  Amanda L. Wilson,et al.  Co-benefits of designing communities for active living: an exploration of literature , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[4]  Stephen J Mooney,et al.  Development and deployment of the Computer Assisted Neighborhood Visual Assessment System (CANVAS) to measure health-related neighborhood conditions. , 2015, Health & place.

[5]  Valter Silva,et al.  Geoprocessing via google maps for assessing obesogenic built environments related to physical activity and chronic noncommunicable diseases: validity and reliability. , 2015, Journal of healthcare engineering.

[6]  Lawrence D Frank,et al.  Contribution of streetscape audits to explanation of physical activity in four age groups based on the Microscale Audit of Pedestrian Streetscapes (MAPS). , 2014, Social science & medicine.

[7]  T. Gary,et al.  Built environment and health behaviors among African Americans: a systematic review. , 2009, American journal of preventive medicine.

[8]  Ann Forsyth,et al.  The Street Level Built Environment and Physical Activity and Walking , 2011 .

[9]  James F. Sallis,et al.  Comparison of field and online observations for measuring land uses using the Microscale Audit of Pedestrian Streetscapes (MAPS) , 2016 .

[10]  Christine M. Hoehner,et al.  How reliably do community members audit the neighborhood environment for its support of physical activity? Implications for participatory research. , 2006, Journal of public health management and practice : JPHMP.

[11]  Christine M. Hoehner,et al.  Measuring the built environment for physical activity: state of the science. , 2009, American journal of preventive medicine.

[12]  Stephen J Mooney,et al.  Validity of an ecometric neighborhood physical disorder measure constructed by virtual street audit. , 2014, American journal of epidemiology.

[13]  P. Shrout.  Measurement reliability and agreement in psychiatry , 1998, Statistical methods in medical research.

[14]  K. Glanz,et al.  An Ecological Perspective on Health Promotion Programs , 1988, Health education quarterly.

[15]  Xiaojun Tang,et al.  A community-based approach to non-communicable chronic disease management within a context of advancing universal health coverage in China: progress and challenges , 2014, BMC Public Health.

[16]  Greet Cardon,et al.  Assessing the environmental characteristics of cycling routes to school: a study on the reliability and validity of a Google Street View-based audit , 2014, International Journal of Health Geographics.

[17]  J. Sallis,et al.  Obesogenic neighborhood environments, child and parent obesity: the Neighborhood Impact on Kids study. , 2012, American journal of preventive medicine.

[18]  Francisco Escobar,et al.  Assessing Walking and Cycling Environments in the Streets of Madrid: Comparing On-Field and Virtual Audits , 2015, Journal of Urban Health.

[19]  Kristina Potocnik,et al.  The Encyclopedia of Adulthood and Aging , 2015 .

[20]  J. Sallis,et al.  The development of a walkability index: application to the Neighborhood Quality of Life Study , 2009, British Journal of Sports Medicine.

[21]  Marlon G. Boarnet,et al.  The Relationship of Neighbourhood Built Environment Features and Adult Parents' Walking , 2008 .

[22]  Lawrence D Frank,et al.  Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS) , 2013, BMC Public Health.

[23]  Paul E Peppard,et al.  The Wisconsin Assessment of the Social and Built Environment (WASABE): a multi-dimensional objective audit instrument for examining neighborhood effects on health , 2014, BMC Public Health.

[24]  Carrie M. Geremia,et al.  Using an audit tool (MAPS Global) to assess the characteristics of the physical environment related to walking for transport in youth: reliability of Belgian data , 2016, International Journal of Health Geographics.

[25]  Ibrahim Elmadfa,et al.  Behaviour change for better health: nutrition, hygiene and sustainability , 2013, BMC Public Health.

[26]  Anne Vernez Moudon,et al.  Walking and Bicycling: An Evaluation of Environmental Audit Instruments , 2003, American journal of health promotion : AJHP.

[27]  Lawrence D Frank,et al.  Developing and Validating an Abbreviated Version of the Microscale Audit for Pedestrian Streetscapes (MAPS-Abbreviated). , 2017, Journal of transport & health.

[28]  Bronwen T. Taylor,et al.  Measuring the quality of public open space using Google Earth. , 2011, American journal of preventive medicine.

[29]  Andy P. Jones,et al.  Assessing environmental features related to mental health: a reliability study of visual streetscape images , 2014, BMC Public Health.

[30]  M McKee,et al.  Using remote sensing to define environmental characteristics related to physical activity and dietary behaviours: a systematic review (the SPOTLIGHT project). , 2014, Health & place.

[31]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[32]  Carrie M. Geremia,et al.  Is Your Neighborhood Designed to Support Physical Activity? A Brief Streetscape Audit Tool , 2015, Preventing chronic disease.

[33]  Jae Seung Lee,et al.  Virtual and actual: relative accuracy of on-site and web-based instruments in auditing the environment for physical activity. , 2013, Health & place.

[34]  H. Badland,et al.  Can Virtual Streetscape Audits Reliably Replace Physical Streetscape Audits? , 2010, Journal of Urban Health.

[35]  Douglas K Miller,et al.  Assessing the built environment using omnidirectional imagery. , 2012, American journal of preventive medicine.

[36]  Robert S. Stawski,et al.  Measurement Burst Design , 2015 .

[37]  M. Guha.  The Encyclopedia of Adulthood and Aging , 2016 .

[38]  Takemi Sugiyama,et al.  Perceived neighbourhood environmental attributes and prospective changes in TV viewing time among older Australian adults , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[39]  James F Sallis,et al.  Reliability between online raters with varying familiarities of a region: Microscale Audit of Pedestrian Streetscapes (MAPS). , 2017, Landscape and urban planning.

[40]  Jennifer Ailshire,et al.  Using Google Earth to conduct a neighborhood audit: reliability of a virtual audit instrument. , 2010, Health & place.

[41]  John R Bethlehem,et al.  The SPOTLIGHT virtual audit tool: a valid and reliable tool to assess obesogenic characteristics of the built environment , 2014, International Journal of Health Geographics.