Feature Enhancement And Fusion For Image-Based Particle Matter Estimation With F-MSE Loss

Air pollution is a major hazard to environment and human health. Particle matter with a diameter less than 2.5 micrometers (PM25) is a very harmful air pollutant that can penetrate deeply into lungs through human respiratory system. In this paper, we propose an efficient and reliable method to estimate PM25 concentration using outdoor images. Firstly, a prior attention block based on gradient features is used to enhance the boundary area between the sky region and the object in a feature map. After that, an embedding layer is applied to encode weather information and fuse it with image features. Finally, a deep neural network model with a novel loss function, F-MSE, is constructed to combine the prediction error of each model level during the training process and to further improve the effectiveness of the presented method. The proposed method was evaluated on a PM2.5 dataset with 1,514 images and the experimental results demonstrate that our method outperformed other existing methods.

[1]  Cheng Guo,et al.  Entity Embeddings of Categorical Variables , 2016, ArXiv.

[2]  Jing Zhang,et al.  Image-based air quality analysis using deep convolutional neural network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[3]  Zanbo Zhu,et al.  Image and Spectrum Based Deep Feature Analysis for Particle Matter Estimation with Weather Informatio , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[4]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[5]  Bo Jiang,et al.  A Shallow ResNet with Layer Enhancement for Image-Based Particle Pollution Estimation , 2018, PRCV.

[6]  D. Dockery,et al.  Health Effects of Fine Particulate Air Pollution: Lines that Connect , 2006, Journal of the Air & Waste Management Association.

[7]  Ke Gu,et al.  Highly Efficient Picture-Based Prediction of PM2.5 Concentration , 2019, IEEE Transactions on Industrial Electronics.

[8]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Yan Peng,et al.  Relationships of relative humidity with PM2.5 and PM10 in the Yangtze River Delta, China , 2017, Environmental Monitoring and Assessment.

[10]  Jing Zhang,et al.  Ensemble of Deep Neural Networks for Estimating Particulate Matter from Images , 2018, 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC).

[11]  Yuan Cheng,et al.  Humidity plays an important role in the PM₂.₅ pollution in Beijing. , 2015, Environmental pollution.

[12]  Yuyuan Tian,et al.  Particle Pollution Estimation Based on Image Analysis , 2016, PloS one.

[13]  Kun Li,et al.  Image-based Air Pollution Estimation Using Hybrid Convolutional Neural Network , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[14]  Jing Zhang,et al.  Particle Pollution Estimation from Images Using Convolutional Neural Network and Weather Features , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[15]  Uthai Phommasak,et al.  Detecting Foggy Images and Estimating the Haze Degree Factor , 2014 .