Space eye on flying aircraft: From Sentinel-2 MSI parallax to hybrid computing

Abstract Knowledge of the status (position and speed) of flying aircraft is vital for efficient and safe air space management. However, this requirement is often compromised due to the complexity of the aviation environment. Satellite remote sensing (RS) provides a complementary means for tracing aircraft, but is often limited to finding motionless aircraft under specific scenarios (e.g., at airports). Here, based on the inter-band offsets due to hardware parallax in push-broom sensors (e.g., Sentinel-2 Multispectral Instrument or MSI), we develop a method for detecting flying aircraft in an automated fashion. Supported by a hybrid computation framework (based on Google Earth Engine computation and local computation) specifically designed to address the challenge of processing large volume of moderate resolution RS data at a global scale, the method is applied to more than 2.31 million MSI images to establish a map of the global distribution of flying aircraft. The detected flying aircraft coincide well with those determined using traditional techniques (e.g., Flightradar24), when both datasets co-exist. With the existing and future moderate-resolution data captured by push-broom satellite sensors, the method is believed to provide a robust and cost-effective means of detecting aircraft status at a global scale, thus supplementing the traditional methods for tracking flying aircraft. The same method is also used to estimate the inter-band and inter-granule time offsets in multi-band MSI and Landsat-8 Operational Land Imager (OLI) images, which may provide critical information needed to correct artifacts in aquatic applications.

[1]  A. Kääb,et al.  Motion detection using near-simultaneous satellite acquisitions , 2014 .

[2]  Libao Zhang,et al.  Airport Detection and Aircraft Recognition Based on Two-Layer Saliency Model in High Spatial Resolution Remote-Sensing Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  David P. Roy,et al.  A Global Analysis of Sentinel-2A, Sentinel-2B and Landsat-8 Data Revisit Intervals and Implications for Terrestrial Monitoring , 2017, Remote. Sens..

[4]  J. Pekel,et al.  High-resolution mapping of global surface water and its long-term changes , 2016, Nature.

[5]  Radha Poovendran,et al.  Aviation Cyber–Physical Systems: Foundations for Future Aircraft and Air Transport , 2013, Proceedings of the IEEE.

[6]  Julia A. Barsi,et al.  The next Landsat satellite: The Landsat Data Continuity Mission , 2012 .

[7]  Robert F. Mills,et al.  Security analysis of the ADS-B implementation in the next generation air transportation system , 2011, Int. J. Crit. Infrastructure Prot..

[8]  Serge Andréfouët,et al.  Sea surface correction of high spatial resolution Ikonos images to improve bottom mapping in near-shore environments , 2003, IEEE Trans. Geosci. Remote. Sens..

[9]  Rajendra Akerkar,et al.  Analytics on Big Aviation Data: Turning Data into Insights , 2014, Int. J. Comput. Sci. Appl..

[10]  S. Vinu Kiran,et al.  Airline Route Profitability Analysis and Optimization Using BIG DATA Analyticson Aviation Data Sets under Heuristic Techniques , 2016 .

[11]  David Thau,et al.  The global distribution and trajectory of tidal flats , 2018, Nature.

[12]  Jun Zhou,et al.  VHR Object Detection Based on Structural Feature Extraction and Query Expansion , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  P. Levelt,et al.  ESA's sentinel missions in support of Earth system science , 2012 .

[14]  A. Pahsa,et al.  Integrating navigation & surveillance of Unmanned Air Vehicles into the civilian national airspaces by using ADS-B applications , 2011, 2011 Integrated Communications, Navigation, and Surveillance Conference Proceedings.

[15]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[16]  Akira Iwasaki,et al.  Correction of Attitude Fluctuation of Terra Spacecraft Using ASTER/SWIR Imagery With Parallax Observation , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  David S. Lee,et al.  Flying into the future: aviation emissions scenarios to 2050. , 2010, Environmental science & technology.

[18]  Andreas Uhl,et al.  Improvement of the Fmask algorithm for Sentinel-2 images: Separating clouds from bright surfaces based on parallax effects , 2018, Remote Sensing of Environment.

[19]  C. Justice,et al.  High-Resolution Global Maps of 21st-Century Forest Cover Change , 2013, Science.

[20]  Marc E.J. Stettler,et al.  Rapid estimation of global civil aviation emissions with uncertainty quantification , 2013 .

[21]  Bo Du,et al.  Weakly Supervised Learning Based on Coupled Convolutional Neural Networks for Aircraft Detection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  John R. Schott,et al.  Landsat 8 Remote Sensing Reflectance (Rrs) Products: Evaluations, Intercomparisons, and Enhancements , 2017 .

[23]  S. Hook,et al.  The ASTER spectral library version 2.0 , 2009 .

[24]  Junwei Han,et al.  Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding , 2014 .

[25]  F. Zhao,et al.  Detection flying aircraft from Landsat 8 OLI data , 2018 .

[26]  Xian Sun,et al.  Aircraft Recognition in High-Resolution Satellite Images Using Coarse-to-Fine Shape Prior , 2013, IEEE Geoscience and Remote Sensing Letters.

[27]  Edward J. Knight,et al.  Landsat-8 Operational Land Imager Design, Characterization and Performance , 2014, Remote. Sens..

[28]  P. Minnis,et al.  Contrail radiative forcing over the Northern Hemisphere from 2006 Aqua MODIS data , 2013 .

[29]  Hong Huo,et al.  Rotation-Invariant Object Detection of Remotely Sensed Images Based on Texton Forest and Hough Voting , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[30]  H. Gordon,et al.  Surface-roughness considerations for atmospheric correction of ocean color sensors. I: The Rayleigh-scattering component. , 1992, Applied optics.

[31]  David S. Lee,et al.  Transport impacts on atmosphere and climate: Aviation , 2009, Atmospheric Environment.

[32]  Lin Yan,et al.  Sentinel-2A multi-temporal misregistration characterization and an orbit-based sub-pixel registration methodology , 2018, Remote Sensing of Environment.

[33]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[34]  Lynn Price,et al.  Sectoral trends in global energy use and greenhouse gasemissions , 2006 .

[35]  Jian Li,et al.  Best practices for the reprojection and resampling of Sentinel-2 Multi Spectral Instrument Level 1C data , 2016 .

[36]  Chi-Ren Shyu,et al.  Entropy-Balanced Bitmap Tree for Shape-Based Object Retrieval From Large-Scale Satellite Imagery Databases , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Jérôme M. B. Louis,et al.  Copernicus Sentinel-2A Calibration and Products Validation Status , 2017, Remote. Sens..

[38]  Philip J. Wolfe,et al.  Impact of aviation on climate: FAA’s Aviation Climate Change Research Initiative (ACCRI) Phase II , 2016 .

[39]  Michael E. Schaepman,et al.  Sentinels for science: potential of Sentinel-1, -2, and -3 missions for scientific observations of ocean, cryosphere, and land , 2012 .

[40]  H. Gordon,et al.  Surface-roughness considerations for atmospheric correction of ocean color sensors. II: Error in the retrieved water-leaving radiance. , 1992, Applied optics.

[41]  W. Munk,et al.  Measurement of the Roughness of the Sea Surface from Photographs of the Sun’s Glitter , 1954 .

[42]  B. Kärcher,et al.  Global radiative forcing from contrail cirrus , 2011 .

[43]  B. Kärcher Formation and radiative forcing of contrail cirrus , 2018, Nature Communications.

[44]  S. Bailey,et al.  Correction of Sun glint Contamination on the SeaWiFS Ocean and Atmosphere Products. , 2001, Applied optics.

[45]  Yusheng Xu,et al.  Framework of Jitter Detection and Compensation for High Resolution Satellites , 2014, Remote. Sens..

[46]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[47]  Bryan A. Franz,et al.  Sentinel-2 MultiSpectral Instrument (MSI) data processing for aquatic science applications: Demonstrations and validations , 2017 .

[48]  P. Minnis,et al.  Estimation of 2006 Northern Hemisphere contrail coverage using MODIS data , 2013 .

[49]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..