A pipeline for automated processing of Corona KH-4 (1962-1972) stereo imagery

The Corona KH-4 reconnaissance satellite missions from 1962-1972 acquired panoramic stereo imagery with high spatial resolution of 1.8-7.5 m. The potential of 800,000+ declassified Corona images has not been leveraged due to the complexities arising from handling of panoramic imaging geometry, film distortions and limited availability of the metadata required for georeferencing of the Corona imagery. This paper presents Corona Stereo Pipeline (CoSP): A pipeline for processing of Corona KH-4 stereo panoramic imagery. CoSP utlizes a deep learning based feature matcher SuperGlue to automatically match features point between Corona KH-4 images and recent satellite imagery to generate Ground Control Points (GCPs). To model the imaging geometry and the scanning motion of the panoramic KH-4 cameras, a rigorous camera model consisting of modified collinearity equations with time dependent exterior orientation parameters is employed. The results show that using the entire frame of the Corona image, bundle adjustment using well-distributed GCPs results in an average standard deviation (SD) or σ0 of less than 2 pixels. We evaluate fiducial marks on the Corona films and show that pre-processing the Corona images to compensate for film bending improves the accuracy. We further assess a polynomial epipolar resampling method for rectification of Corona stereo images. The distortion pattern of image residuals of GCPs and y-parallax in epipolar resampled images suggest that film distortions due to long term storage as likely cause of systematic deviations. Compared to the SRTM DEM, the Corona DEM computed using CoSP achieved a Normalized Median Absolute Deviation (NMAD) of elevation differences of ≈ 4m over an area of approx. 4000 km. We show that the proposed pipeline can be applied to sequence of complex scenes involving high relief and glacierized terrain and that the resulting DEMs can be used to compute long term glacier elevation changes over large areas.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  B. Robson,et al.  Spatial Variability in Patterns of Glacier Change across the Manaslu Range, Central Himalaya , 2018, Front. Earth Sci..

[3]  T. Bolch,et al.  High Mountain Asian glacier response to climate revealed by multi-temporal satellite observations since the 1960s , 2021, Nature Communications.

[4]  Arzhan B. Surazakov,et al.  Positional accuracy evaluation of declassified hexagon KH-9 mapping camera imagery. , 2010 .

[5]  N. Watanabe,et al.  Utilization of Structure from Motion for processing CORONA satellite images: Application to mapping and interpretation of archaeological features in Liangzhu Culture, China , 2017 .

[6]  T. Bolch,et al.  Six Decades of Glacier Mass Changes around Mt. Everest Are Revealed by Historical and Contemporary Images , 2020 .

[7]  Ewelina Rupnik,et al.  SIMULATION AND ANALYSIS OF PHOTOGRAMMETRIC UAV IMAGE BLOCKS: INFLUENCE OF CAMERA CALIBRATION ERROR , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[8]  B. Menounos,et al.  Accelerated global glacier mass loss in the early twenty-first century , 2021, Nature.

[9]  Y. Arnaud,et al.  Spatial patterns in glacier characteristics and area changes from 1962 to 2006 in the Kanchenjunga–Sikkim area, eastern Himalaya , 2015 .

[10]  M. Fowler,et al.  Detection of archaeological crop marks on declassified CORONA KH‐4B intelligence satellite photography of Southern England , 2005 .

[11]  Angela Altmaier,et al.  Digital surface model generation from CORONA satellite images , 2002 .

[12]  J. Maurer,et al.  Tapping into the Hexagon spy imagery database: A new automated pipeline for geomorphic change detection , 2015 .

[13]  U. Acar,et al.  COAST LINE CHANGE DETECTION USING CORONA , SPOT and IRS 1 D IMAGES , 2004 .

[14]  T. Bolch,et al.  Inventory and changes of rock glacier creep speeds in Ile Alatau and Kungöy Ala-Too, northern Tien Shan, since the 1950s , 2021 .

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  M. Ishikawa,et al.  Thermokarst Lake Changes in the Southern Fringe of Siberian Permafrost Region in Mongolia Using Corona, Landsat, and ALOS Satellite Imagery from 1962 to 2007 , 2016 .

[17]  M. Nüsser,et al.  Changes of High Altitude Glaciers from 1969 to 2010 in the Trans-Himalayan Kang Yatze Massif, Ladakh, Northwest India , 2012 .

[18]  T. Bolch,et al.  Planimetric and volumetric glacier changes in the Khumbu Himal, Nepal, since 1962 using Corona, Landsat TM and ASTER data , 2008 .

[19]  Tobias Bolch,et al.  Glacier Mass Loss during the 1960s and 1970s in the Ak-Shirak Range (Kyrgyzstan) from Multiple Stereoscopic Corona and Hexagon Imagery , 2017, Remote. Sens..

[20]  Norbert Pfeifer,et al.  OPALS - A framework for Airborne Laser Scanning data analysis , 2014, Comput. Environ. Urban Syst..

[21]  D. Donoghue,et al.  High Resolution Elevation Data Derived from Stereoscopic CORONA Imagery with Minimal Ground Control: An Approach Using Ikonos and SRTM Data , 2007 .

[22]  Tomasz Malisiewicz,et al.  SuperPoint: Self-Supervised Interest Point Detection and Description , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[23]  Andreas Kääb,et al.  MMASTER: Improved ASTER DEMs for Elevation Change Monitoring , 2017, Remote. Sens..

[24]  Manfred F. Buchroithner,et al.  Identification of potentially dangerous glacial lakes in the northern Tien Shan , 2011 .

[25]  Ewelina Rupnik,et al.  Feature matching for multi-epoch historical aerial images , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.

[26]  Scott McMichael,et al.  The Ames Stereo Pipeline: NASA's Open Source Software for Deriving and Processing Terrain Data , 2018, Earth and Space Science.

[27]  Ewelina Rupnik,et al.  Epipolar rectification of a generic camera , 2020 .

[28]  K. V. Kumar,et al.  Remote sensing-based hazard assessment of glacial lakes in Sikkim Himalaya , 2013 .

[29]  Karsten Jacobsen,et al.  Scan Problems in Digital CORONA Satellite Images from USGS Archives , 2011 .

[30]  C. Fraser,et al.  Sensor orientation via RPCs , 2006 .

[31]  Gi-Hong Kim,et al.  Mathematical modelling of historical reconnaissance CORONA KH-4B Imagery , 2004 .

[32]  T. Bolch,et al.  Occurrence, evolution and ice content of ice‐debris complexes in the Ak‐Shiirak, Central Tien Shan revealed by geophysical and remotely‐sensed investigations , 2018, Earth Surface Processes and Landforms.

[33]  Ferdinand Maiwald,et al.  An automatic workflow for orientation of historical images with large radiometric and geometric differences , 2021, The Photogrammetric Record.

[34]  T. Bolch,et al.  The Randolph Glacier inventory: a globally complete inventory of glaciers , 2014 .

[35]  C. Tao,et al.  A Comprehensive Study of the Rational Function Model for Photogrammetric Processing , 2001 .

[36]  Bharat Lohani,et al.  A repository of earth resource information - CORONA satellite programme , 2007 .

[37]  Tobias Bolch,et al.  Glacier changes in the Garhwal Himalaya, India, from 1968 to 2006 based on remote sensing , 2011, Journal of Glaciology.

[38]  Tony Schenk,et al.  Rigorous Modeling of the First Generation of the Reconnaissance Satellite Imagery , 2008 .

[39]  Takeo Tadono,et al.  PRECISE GLOBAL DEM GENERATION BY ALOS PRISM , 2014 .

[40]  I. Noaje,et al.  ENVIRONMENTAL CHANGES ANALYSIS IN BUCHAREST CITY USING CORONA, SPOT HRV AND IKONOS IMAGES , 2012 .

[41]  Juha Hyyppä,et al.  ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences , 2016 .

[42]  Tomasz Malisiewicz,et al.  SuperGlue: Learning Feature Matching With Graph Neural Networks , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  A. Kääb,et al.  Co-registration and bias corrections of satellite elevation data sets for quantifying glacier thickness change , 2011 .

[44]  Donald Kawachi.  Image Displacements on a Tilted Panoramic Photograph , 1963 .

[45]  T. Bolch,et al.  Glacial lakes exacerbate Himalayan glacier mass loss , 2019, Scientific Reports.

[46]  J. Maurer,et al.  Acceleration of ice loss across the Himalayas over the past 40 years , 2019, Science Advances.

[47]  Norbert Pfeifer,et al.  APPLYING 3D AFFINE TRANSFORMATION AND LEAST SQUARES MATCHING FOR AIRBORNE LASER SCANNING STRIPS ADJUSTMENT WITHOUT GNSS/IMU TRAJECTORY DATA , 2012 .

[48]  T. Bolch,et al.  More dynamic than expected: An updated survey of surging glaciers in the Pamir , 2020 .

[49]  O. Alexandrov,et al.  Automated Processing of Declassified KH-9 Hexagon Satellite Images for Global Elevation Change Analysis Since the 1970s , 2020, Frontiers in Earth Science.

[50]  Liu Shiyin,et al.  Heterogeneous mass loss of glaciers in the Aksu-Tarim Catchment (Central Tien Shan) revealed by 1976 KH-9 Hexagon and 2009 SPOT-5 stereo imagery , 2013 .

[51]  R. Binet,et al.  Measurement of ground displacement from optical satellite image correlation using the free open-source software MicMac , 2015 .

[52]  Nikolaos Galiatsatos,et al.  Assessment of the CORONA series of satellite imagery for landscape archaeology : a case study from the Orontes valley, Syria , 2004 .

[53]  T. Bolch,et al.  Region-wide glacier mass budgets and area changes for the Central Tien Shan between ~ 1975 and 1999 using Hexagon KH-9 imagery , 2015 .