Coloring Panchromatic Nighttime Satellite Images: Comparing the Performance of Several Machine Learning Methods

Artificial light-at-night (ALAN), emitted from the ground and visible from space, marks human presence on earth. Since the launch of the Suomi National Polar Partnership satellite with the Visible Infrared Imaging Radiometer Suite Day–Night Band (VIIRS/DNB) onboard, global nighttime images have significantly improved; however, they remained panchromatic. Although multispectral images are also available, they are either commercial or free of charge, but sporadic. In this article, we use several machine learning techniques, such as linear, kernel, random forest regressions, and elastic map approach, to transform panchromatic VIIRS/DBN into red, green, blue (RGB) images. To validate the proposed approach, we analyze RGB images for eight urban areas worldwide. We link RGB values, obtained from ISS photographs, to panchromatic ALAN intensities, their pixel-wise differences, and several land-use-type proxies. Each dataset is used for model training, while other datasets are used for model validation. The analysis shows that model-estimated RGB images demonstrate a high degree of correspondence with the original RGB images from the ISS database. Yet, estimates, based on linear, kernel, and random forest regressions, provide better correlations, contrast similarity, and lower WMSEs levels, while RGB images, generated using elastic map approach, provide higher consistency of predictions.

[1]  Alexander N. Gorban,et al.  Visualization of Data by Method of Elastic Maps and Its Applications in Genomics, Economics and Sociology , 2001 .

[2]  José I. Barredo,et al.  Are European Cities Becoming Dispersed? A Comparative Analysis of 15 European Urban Areas , 2006 .

[3]  Gregoire Mariethoz,et al.  Analogue-based colorization of remote sensing images using textural information , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[4]  M. Herold,et al.  Spatial Metrics and Image Texture for Mapping Urban Land Use , 2003 .

[5]  I. Kloog,et al.  Nighttime light level co-distributes with breast cancer incidence worldwide , 2010, Cancer Causes & Control.

[6]  P. Sutton,et al.  Characterizing relationships between population density and nighttime imagery for Denver, Colorado: issues of scale and representation , 2010 .

[7]  Boulder,et al.  The artificial night sky brightness mapped from DMSP satellite Operational Linescan System measurements , 2000, astro-ph/0003412.

[8]  Charles A. Czeisler,et al.  Perspective: Casting light on sleep deficiency , 2013, Nature.

[9]  J. Henderson,et al.  Measuring Economic Growth from Outer Space , 2009, The American economic review.

[10]  Christopher D. F. Rogers,et al.  Mapping Lightscapes: Spatial Patterning of Artificial Lighting in an Urban Landscape , 2013, PloS one.

[11]  Alexander N. Gorban,et al.  Elastic Principal Graphs and Manifolds and their Practical Applications , 2005, Computing.

[12]  J. A. Quintanilha,et al.  DMSP/OLS night‐time light imagery for urban population estimates in the Brazilian Amazon , 2006 .

[13]  C. Elvidge,et al.  The new world atlas of artificial night sky brightness , 2016, Science Advances.

[14]  B. Portnov,et al.  Light Pollution as a New Risk Factor for Human Breast and Prostate Cancers , 2013, Springer Netherlands.

[15]  H. Wright,et al.  Differential effects of light wavelength in phase advancing the melatonin rhythm , 2004, Journal of pineal research.

[16]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[17]  C. Murray,et al.  From wealth to health: modelling the distribution of income per capita at the sub-national level using night-time light imagery , 2005, International journal of health geographics.

[18]  C. Elvidge,et al.  Relation between satellite observed visible-near infrared emissions, population, economic activity and electric power consumption , 1997 .

[19]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[20]  Xiao Xiang Zhu,et al.  Semantic segmentation of slums in satellite images using transfer learning on fully convolutional neural networks , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[21]  K. Baugh,et al.  Light pollution in USA and Europe: The good, the bad and the ugly. , 2019, Journal of environmental management.

[22]  Christopher D. Elvidge,et al.  Spectral Identification of Lighting Type and Character , 2010, Sensors.

[23]  Kevin J. Gaston,et al.  Global Trends in Exposure to Light Pollution in Natural Terrestrial Ecosystems , 2015, Remote. Sens..

[24]  Yuxia Huang,et al.  Association between nighttime artificial light pollution and sea turtle nest density along Florida coast: A geospatial study using VIIRS remote sensing data. , 2018, Environmental pollution.

[25]  C. Elvidge,et al.  Why VIIRS data are superior to DMSP for mapping nighttime lights , 2013 .

[26]  D. Roberts,et al.  Census from Heaven: An estimate of the global human population using night-time satellite imagery , 2001 .

[27]  Noam Levin,et al.  Analyzing spatial variability in night-time lights using a high spatial resolution color Jilin-1 image – Jerusalem as a case study , 2020 .

[28]  Deepu Rajan,et al.  Image colorization using similar images , 2012, ACM Multimedia.

[29]  P. Sutton,et al.  Shedding Light on the Global Distribution of Economic Activity , 2010 .

[30]  I. Kloog,et al.  Global Co‐Distribution of Light at Night (LAN) and Cancers of Prostate, Colon, and Lung in Men , 2009, Chronobiology international.

[31]  C. Mellander,et al.  Night-Time Light Data: A Good Proxy Measure for Economic Activity? , 2015, PloS one.

[32]  Ling Shao,et al.  Single satellite imagery simultaneous super-resolution and colorization using multi-task deep neural networks , 2018, J. Vis. Commun. Image Represent..

[33]  Eleanor C. Stokes,et al.  NASA's Black Marble nighttime lights product suite , 2018, Remote Sensing of Environment.

[34]  B. Portnov,et al.  Remote identification of research and educational activities using spectral properties of nighttime light , 2017 .

[35]  B. Portnov,et al.  Does artificial light-at-night exposure contribute to the worldwide obesity pandemic? , 2016, International Journal of Obesity.

[36]  Jin Chen,et al.  Modelling the population density of China at the pixel level based on DMSP/OLS non‐radiance‐calibrated night‐time light images , 2009 .

[37]  Kevin J. Gaston,et al.  Artificial light at night as a driver of evolution across urban–rural landscapes , 2018, Frontiers in Ecology and the Environment.

[38]  Gregory Shakhnarovich,et al.  Learning Representations for Automatic Colorization , 2016, ECCV.

[39]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[40]  Lu Zhang,et al.  Regional Inequality in China Based on NPP-VIIRS Night-Time Light Imagery , 2018, Remote. Sens..

[41]  R. Manne,et al.  Missing values in principal component analysis , 1998 .

[42]  A. Wirz-Justice,et al.  High sensitivity of human melatonin, alertness, thermoregulation, and heart rate to short wavelength light. , 2005, The Journal of clinical endocrinology and metabolism.

[43]  C. Elvidge,et al.  Remote sensing of night lights: A review and an outlook for the future , 2020, Remote Sensing of Environment.

[44]  Dae Seo,et al.  Learning-Based Colorization of Grayscale Aerial Images Using Random Forest Regression , 2018, Applied Sciences.

[45]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.

[46]  B. Portnov,et al.  Outdoor light and breast cancer incidence: a comparative analysis of DMSP and VIIRS-DNB satellite data , 2017, Remote Sensing of Night-time Light.

[47]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[48]  G. Brainard,et al.  Action Spectrum for Melatonin Regulation in Humans: Evidence for a Novel Circadian Photoreceptor , 2001, The Journal of Neuroscience.

[49]  Peter Boyce,et al.  Lighting appraisal, well-being and performance in open-plan offices: A linked mechanisms approach , 2008 .

[50]  Alexander N. Gorban,et al.  Principal Manifolds and Graphs in Practice: from Molecular Biology to Dynamical Systems , 2010, Int. J. Neural Syst..