Towards Improved Air Quality Monitoring Using Publicly Available Sky Images

Air pollution causes nearly half a million premature deaths each year in Europe. Despite air quality directives that demand compliance with air pollution value limits, many urban populations continue being exposed to air pollution levels that exceed by far the guidelines. Unfortunately, official air quality sensors are sparse, limiting the accuracy of the provided air quality information. In this chapter, we explore the possibility of extending the number of air quality measurements that are fed into existing air quality monitoring systems by exploiting techniques that estimate air quality based on sky-depicting images. We first describe a comprehensive data collection mechanism and the results of an empirical study on the availability of sky images in social image sharing platforms and on webcam sites. In addition, we present a methodology for automatically detecting and extracting the sky part of the images leveraging deep learning models for concept detection and localization. Finally, we present an air quality estimation model that operates on statistics computed from the pixel color values of the detected sky regions.

[1]  H. Iwabuchi,et al.  A new method of measuring aerosol optical properties from digital twilight photographs , 2015 .

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Catherine Gautier,et al.  SBDART: A Research and Teaching Software Tool for Plane-Parallel Radiative Transfer in the Earth's Atmosphere. , 1998 .

[4]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[5]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  J. Seinfeld,et al.  Atmospheric Chemistry and Physics: From Air Pollution to Climate Change , 1997 .

[7]  Yiannis Kompatsiaris,et al.  Towards Air Quality Estimation Using Collected Multimodal Environmental Data , 2016, IFIN/ISEM@INSCI.

[8]  Dennis Koelma,et al.  Qualcomm Research and University of Amsterdam at TRECVID 2015: Recognizing Concepts, Objects, and Events in Video , 2015, TRECVID.

[9]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[10]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Thomas Sikora,et al.  The MPEG-7 visual standard for content description-an overview , 2001, IEEE Trans. Circuits Syst. Video Technol..

[12]  Krista A. Ehinger,et al.  SUN database: Large-scale scene recognition from abbey to zoo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Jonathan Tompson,et al.  Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation , 2014, NIPS.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Javier Hernández-Andrés,et al.  Retrieval of the optical depth using an all-sky CCD camera. , 2008, Applied optics.

[16]  D. Sarigiannis,et al.  Health impact and monetary cost of exposure to particulate matter emitted from biomass burning in large cities. , 2015, The Science of the total environment.

[17]  C. Zerefos,et al.  Atmospheric effects of volcanic eruptions as seen by famous artists and depicted in their paintings , 2007 .

[18]  Xuesong Jin,et al.  A Novel Sky Region Detection Algorithm Based On Border Points , 2015 .

[19]  Yann LeCun,et al.  Toward automatic phenotyping of developing embryos from videos , 2005, IEEE Transactions on Image Processing.

[20]  O. Boucher,et al.  Estimates of the direct and indirect radiative forcing due to tropospheric aerosols: A review , 2000 .

[21]  Jitendra Malik,et al.  Simultaneous Detection and Segmentation , 2014, ECCV.

[22]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[23]  Christos Zerefos,et al.  Further evidence of important environmental information content in red-to-green ratios as depicted in paintings by great masters , 2013 .

[24]  Jitendra Malik,et al.  Learning Rich Features from RGB-D Images for Object Detection and Segmentation , 2014, ECCV.

[25]  Victor S. Lempitsky,et al.  N4-Fields: Neural Network Nearest Neighbor Fields for Image Transforms , 2014, ArXiv.

[26]  K. Stamnes,et al.  Numerically stable algorithm for discrete-ordinate-method radiative transfer in multiple scattering and emitting layered media. , 1988, Applied optics.

[27]  Ioannis Patras,et al.  Cascade of classifiers based on binary, non-binary and deep convolutional network descriptors for video concept detection , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[28]  Eleni Marinou,et al.  Spatiotemporal variability and contribution of different aerosol types to the Aerosol Optical Depth over the Eastern Mediterranean. , 2016, Atmospheric chemistry and physics.

[29]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[30]  Chunyan Miao,et al.  Crowdsensing Air Quality with Camera-Enabled Mobile Devices , 2017, AAAI.

[31]  Grigorios Tsoumakas,et al.  A Comprehensive Study Over VLAD and Product Quantization in Large-Scale Image Retrieval , 2014, IEEE Transactions on Multimedia.

[32]  Ronan Collobert,et al.  Recurrent Convolutional Neural Networks for Scene Labeling , 2014, ICML.

[33]  Damien Igoe,et al.  Characterization of a Smartphone Camera's Response to Ultraviolet A Radiation , 2013, Photochemistry and photobiology.

[34]  Yiannis Kompatsiaris,et al.  Sensing Trending Topics in Twitter , 2013, IEEE Transactions on Multimedia.

[35]  Georgia Alexandri,et al.  On the ability of RegCM4 regional climate model to simulate surface solar radiation patterns over Europe: an assessment using satellite-based observations , 2015 .

[36]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Robert Pless,et al.  Consistent Temporal Variations in Many Outdoor Scenes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Yuyuan Tian,et al.  Particle Pollution Estimation Based on Image Analysis , 2016, PloS one.

[39]  Changsheng Li,et al.  On Estimating Air Pollution from Photos Using Convolutional Neural Network , 2016, ACM Multimedia.

[40]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[41]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Jiebo Luo,et al.  Using user generated online photos to estimate and monitor air pollution in major cities , 2015, ICIMCS '15.

[43]  Kostas Kourtidis,et al.  A high resolution satellite view of surface solar radiation over the climatically sensitive region of Eastern Mediterranean , 2017 .

[44]  Kai Zhang,et al.  MAC‐v1: A new global aerosol climatology for climate studies , 2013 .