Automated Aerosol Classification from Spectral UV Measurements Using Machine Learning Clustering

In this study, we present an aerosol classification technique based on measurements of a double monochromator Brewer spectrophotometer during the period 1998–2017 in Thessaloniki, Greece. A machine learning clustering procedure was applied based on the Mahalanobis distance metric. The classification process utilizes the UV Single Scattering Albedo (SSA) at 340 nm and the Extinction Angstrom Exponent (EAE) at 320–360 nm that are obtained from the spectrophotometer. The analysis is supported by measurements from a CIMEL sunphotometer that were deployed in order to establish the training dataset of Brewer measurements. By applying the Mahalanobis distance algorithm to the Brewer timeseries, we automatically assigned measurements in one of the following clusters: Fine Non Absorbing Mixtures (FNA): 64.7%, Black Carbon Mixtures (BC): 17.4%, Dust Mixtures (DUST): 8.1%, and Mixed: 9.8%. We examined the clustering potential of the algorithm by reclassifying the training dataset and comparing it with the original one and also by using manually classified cases. The typing score of the Mahalanobis algorithm is high for all predominant clusters FNA: 77.0%, BC: 63.9%, and DUST: 80.3% when compared with the training dataset. We obtained high scores as well FNA: 100.0%, BC: 66.7%, and DUST: 83.3% when comparing it with the manually classified dataset. The flags obtained here were applied in the timeseries of the Aerosol Optical Depth (AOD) at 340 nm of the Brewer and the CIMEL in order to compare between the two and also stress the future impact of the proposed clustering technique in climatological studies of the station.

[1]  Martine De Mazière,et al.  The Network for the Detection of Atmospheric Composition Change (NDACC): history, status and perspectives , 2017 .

[2]  R. Engelmann,et al.  HETEAC: The Aerosol Classification Model for EarthCARE , 2016 .

[3]  A. Bais,et al.  EUBREWNET RBCC-E Huelva 2015 Ozone Brewer Intercomparison , 2018, Atmospheric Chemistry and Physics.

[4]  Mario Blumthaler,et al.  Direct spectral measurements with a Brewer spectroradiometer: absolute calibration and aerosol optical depth retrieval. , 2005, Applied optics.

[5]  James B. Kerr,et al.  SUSPEN intercomparison of ultraviolet spectroradiometers , 2001 .

[6]  Doina Nicolae,et al.  An automatic observation-based aerosol typing method for EARLINET , 2018, Atmospheric Chemistry and Physics.

[7]  Wayne C. Welch,et al.  Airborne high spectral resolution lidar for profiling aerosol optical properties. , 2008, Applied optics.

[8]  F. Esposito,et al.  Aerosol composition and properties variation at the ground and over the column under different air masses advection in South Italy , 2016, Environmental Science and Pollution Research.

[9]  P. Koepke,et al.  Optical Properties of Aerosols and Clouds: The Software Package OPAC , 1998 .

[10]  A. Bais,et al.  Deriving an effective aerosol single scattering albedo from spectral surface UV irradiance measurements , 2005 .

[11]  B. Holben,et al.  An AERONET-based aerosol classification using the Mahalanobis distance , 2016 .

[12]  B. DeAngelo,et al.  Bounding the role of black carbon in the climate system: A scientific assessment , 2013 .

[13]  M Blumthaler,et al.  Correcting global solar ultraviolet spectra recorded by a brewer spectroradiometer for its angular response error. , 1998, Applied optics.

[14]  Julia C. Fussell,et al.  Size, source and chemical composition as determinants of toxicity attributable to ambient particulate matter , 2012 .

[15]  A. Bais,et al.  Aerosol optical depth in the European Brewer Network , 2017 .

[16]  A. Bais,et al.  Solar UVB measurements with the double‐ and single‐monochromator Brewer ozone spectrophotometers , 1996 .

[17]  D. Melas,et al.  Investigating the quality of modeled aerosol profiles based on combined lidar and sunphotometer data , 2017 .

[18]  P. Nastos,et al.  Identification of the Aerosol Types over Athens, Greece: The Influence of Air-Mass Transport , 2010 .

[19]  Thomas F. Eck,et al.  Measurements of irradiance attenuation and estimation of aerosol single scattering albedo for biomass burning aerosols in Amazonia , 1998 .

[20]  A. Bais,et al.  Monitoring of UV spectral irradiance at Thessaloniki (1990–2005): data re-evaluation and quality control , 2006 .

[21]  T. Eck,et al.  Classification of aerosol properties derived from AERONET direct sun data , 2006 .

[22]  J. Baldasano,et al.  Changes in particulate matter physical properties during Saharan advections over Rome (Italy): a four-year study, 2001–2004 , 2013 .

[23]  T. Eck,et al.  Wavelength dependence of the optical depth of biomass burning, urban, and desert dust aerosols , 1999 .

[24]  A. Smirnov,et al.  AERONET-a federated instrument network and data archive for aerosol Characterization , 1998 .

[25]  Anders Ångström,et al.  On the Atmospheric Transmission of Sun Radiation and on Dust in the Air , 1929 .

[26]  Aerosol optical depth determination in the UV using a four-channel precision filter radiometer , 2016 .

[27]  C. Zerefos,et al.  Optical properties of different aerosol types: seven years of combined Raman-elastic backscatter lidar measurements in Thessaloniki, Greece , 2009 .

[28]  C. Brogniez,et al.  Aerosol Single Scattering Albedo retrieval in the UV range: an application to OMI satellite validation , 2009 .

[29]  J. Gröbner,et al.  Aerosol optical depth in the UVB and visible wavelength range from Brewer spectrophotometer direct irradiance measurements: 1991–2002 , 2004 .

[30]  L. Mona,et al.  Comparison of two automated aerosol typing methods and their application to an EARLINET station , 2019, Atmospheric Chemistry and Physics.

[31]  A. Bais,et al.  Short- and long-term variability of spectral solar UV irradiance at Thessaloniki, Greece: effects of changes in aerosols, total ozone and clouds , 2015 .

[32]  Christos Zerefos,et al.  Four‐year aerosol observations with a Raman lidar at Thessaloniki, Greece, in the framework of European Aerosol Research Lidar Network (EARLINET) , 2005 .

[33]  A. Bais,et al.  Absolute spectral measurements of direct solar ultraviolet irradiance with a Brewer spectrophotometer. , 1997, Applied optics.

[34]  A. Bais,et al.  Nine years of UV aerosol optical depth measurements at Thessaloniki, Greece , 2007 .

[35]  A. W. Brewer A replacement for the Dobson spectrophotometer? , 1973 .

[36]  Jasper R. Lewis,et al.  Advancements in the Aerosol Robotic Network (AERONET) Version 3 database – automated near-real-time quality control algorithm with improved cloud screening for Sun photometer aerosol optical depth (AOD) measurements , 2019, Atmospheric Measurement Techniques.

[37]  A. Bais,et al.  Twenty-five years of spectral UV-B measurements over Canada, Europe and Japan: Trends and effects from changes in ozone, aerosols, clouds, and surface reflectivity , 2018, Comptes Rendus Geoscience.

[38]  Doina Nicolae,et al.  A neural network aerosol-typing algorithm based on lidar data , 2018, Atmospheric Chemistry and Physics.

[39]  A. D. Di Sarra,et al.  Aerosol optical characteristics in the urban area of Rome, Italy, and their impact on the UV index , 2019 .

[40]  Brent N. Holben,et al.  Characteristics of aerosol types from AERONET sunphotometer measurements , 2010 .

[41]  L. Oman,et al.  Success of Montreal Protocol Demonstrated by Comparing High-Quality UV Measurements with “World Avoided” Calculations from Two Chemistry-Climate Models , 2019, Scientific Reports.

[42]  B. Weinzierl,et al.  Aerosol classification by airborne high spectral resolution lidar observations , 2012 .

[43]  T. Eck,et al.  Spectral discrimination of coarse and fine mode optical depth , 2003 .

[44]  L. Belegante,et al.  Columnar aerosol measurements in a continental southeastern Europe site: climatology and trends , 2019, Theoretical and Applied Climatology.

[45]  J. Michalsky,et al.  Non-parametric and least squares Langley plot methods , 2015 .

[46]  Michael D. King,et al.  A flexible inversion algorithm for retrieval of aerosol optical properties from Sun and sky radiance measurements , 2000 .

[47]  J. Gröbner,et al.  Traceability of solar UV measurements using the Qasume reference spectroradiometer. , 2016, Applied optics.

[48]  Victoria E. Cachorro,et al.  Airmass Classification and Analysis of Aerosol Types at El Arenosillo (Spain) , 2009 .

[49]  D. Balis,et al.  Are EARLINET and AERONET climatologies consistent? The case of Thessaloniki, Greece , 2018, Atmospheric Chemistry and Physics.

[50]  Iwona S. Stachlewska,et al.  Comparison of Columnar, Surface, and UAS Profiles of Absorbing Aerosol Optical Depth and Single-Scattering Albedo in South-East Poland , 2019, Atmosphere.

[51]  F. Cappellani,et al.  Measurements of aerosol optical depth at Ispra: Analysis of the correlation with UV‐B, UV‐A, and total solar irradiance , 2000 .

[52]  R L McKenzie,et al.  Ozone—climate interactions and effects on solar ultraviolet radiation , 2019, Photochemical & photobiological sciences : Official journal of the European Photochemistry Association and the European Society for Photobiology.

[53]  Oleg Dubovik,et al.  Combined use of satellite and surface observations to infer the imaginary part of refractive index of Saharan dust , 2002 .

[54]  R. Ferrare,et al.  Aerosol classification using airborne High Spectral Resolution Lidar measurements – methodology and examples , 2011 .

[55]  V. Amiridis,et al.  Aerosol Absorption Retrieval at Ultraviolet Wavelengths in a Complex Environment , 2016 .

[56]  S. Madronich,et al.  Retrieval of aerosol single scattering albedo at ultraviolet wavelengths at the T1 site during MILAGRO , 2009 .

[57]  Nikolaos Siomos,et al.  Deriving Aerosol Absorption Properties from Solar Ultraviolet Radiation Spectral Measurements at Thessaloniki, Greece , 2019, Remote. Sens..

[58]  A. Bais,et al.  Validation of OMI erythemal doses with multi-sensor ground-based measurements in Thessaloniki, Greece , 2018, Atmospheric Environment.

[59]  Dimitris G. Kaskaoutis,et al.  Aerosol climatology and discrimination of different types over Athens, Greece, based on MODIS data , 2007 .