Precise Geometric Correction and Robust Mosaicking for Airborne Lightweight Optical Butting Infrared Imaging System

In view of the urgent need for high-resolution and high-precision infrared image data for geological environmental monitoring, we have developed a lightweight optical butting infrared imaging system for unmanned aerial vehicles (UAVs) to obtain infrared image data. In this paper, we proposed a robust mosaicking method combination of as-projective-as-possible warps and similarity transformation, which uses multiple images to generate a wide viewing field panorama. It is developed based on an analysis of projective transformation and similarity transformation. The proposed method simultaneously takes into consideration the flexibility of alignment and the preservation of image shapes. On the overlapping regions, it performs as-projective-as-possible warps. On the non-overlapping regions, it gradually becomes a similarity warp. The results show that the proposed method weakens the “ghosting,” shape distortion, and area distortion.

[1]  Feng Liu,et al.  Panoramic Mosaics from Chang'E-3 PCAM Images at Point A , 2016, Remote. Sens..

[2]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Sing Bing Kang,et al.  Parameter-Free Radial Distortion Correction with Center of Distortion Estimation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Junjun Jiang,et al.  LMR: Learning a Two-Class Classifier for Mismatch Removal , 2019, IEEE Transactions on Image Processing.

[5]  Sang-Jo Yoo,et al.  Optimal UAV Path Planning: Sensing Data Acquisition Over IoT Sensor Networks Using Multi-Objective Bio-Inspired Algorithms , 2018, IEEE Access.

[6]  D. Ming,et al.  Pancam Multispectral Imaging Results from the Spirit Rover at Gusev Crater , 2004, Science.

[7]  Aly A. Farag,et al.  Nonmetric calibration of camera lens distortion: differential methods and robust estimation , 2005, IEEE Transactions on Image Processing.

[8]  Zhuowen Tu,et al.  Robust Point Matching via Vector Field Consensus , 2014, IEEE Transactions on Image Processing.

[9]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[11]  G. F. McLean,et al.  Line-Based Correction of Radial Lens Distortion , 1997, CVGIP Graph. Model. Image Process..

[12]  Tomás Pajdla,et al.  The geometric error for homographies , 2003, Comput. Vis. Image Underst..

[13]  Norbert Pfeifer,et al.  A Case Study of UAS Borne Laser Scanning for Measurement of Tree Stem Diameter , 2017, Remote. Sens..

[14]  Junjun Jiang,et al.  Locality Preserving Matching , 2018, International Journal of Computer Vision.

[15]  D. Ming,et al.  Pancam Multispectral Imaging Results from the Opportunity Rover at Meridiani Planum , 2004, Science.

[16]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[17]  A. Yingst,et al.  A Habitable Fluvio-Lacustrine Environment at Yellowknife Bay, Gale Crater, Mars , 2014, Science.

[18]  Na Wang,et al.  Decentralized Real-Time Estimation and Tracking for Unknown Ground Moving Target Using UAVs , 2019, IEEE Access.

[19]  Weipeng Jing,et al.  A Model of Parallel Mosaicking for Massive Remote Sensing Images Based on Spark , 2017, IEEE Access.

[20]  Meng Li,et al.  3D Digitisation of Large-Scale Unstructured Great Wall Heritage Sites by a Small Unmanned Helicopter , 2017, Remote. Sens..

[21]  Bo Du,et al.  Incorporating Distribution Matching into Uncertainty for Multiple Kernel Active Learning , 2021, IEEE Transactions on Knowledge and Data Engineering.

[22]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Albert Y. Zomaya,et al.  Task-Tree Based Large-Scale Mosaicking for Massive Remote Sensed Imageries with Dynamic DAG Scheduling , 2014, IEEE Transactions on Parallel and Distributed Systems.

[24]  Ryota Arai,et al.  Seamline Determination Based on Semantic Segmentation for Aerial Image Mosaicking , 2015, IEEE Access.

[25]  Farid Melgani,et al.  A Convolutional Neural Network Approach for Assisting Avalanche Search and Rescue Operations with UAV Imagery , 2017, Remote. Sens..

[26]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Po-Li Chen,et al.  Rapidly responding to landslides and debris flow events using a low-cost unmanned aerial vehicle , 2015 .

[28]  Jing Li,et al.  Panoramic UAV Surveillance and Recycling System Based on Structure-Free Camera Array , 2019, IEEE Access.

[29]  Jie Li,et al.  Generalized Content-Preserving Warp: Direct Photometric Alignment Beyond Color Consistency , 2018, IEEE Access.

[30]  Michael S. Brown,et al.  Constructing image panoramas using dual-homography warping , 2011, CVPR 2011.

[31]  Zhengyou Zhang,et al.  Parameter estimation techniques: a tutorial with application to conic fitting , 1997, Image Vis. Comput..

[32]  Bin Jiang,et al.  A Descriptor System Approach for Estimation of Incipient Faults With Application to High-Speed Railway Traction Devices , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Yu-Sheng Chen,et al.  Natural Image Stitching with the Global Similarity Prior , 2016, ECCV.

[35]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[36]  R. V. Morris,et al.  Curiosity at Gale Crater, Mars: Characterization and Analysis of the Rocknest Sand Shadow , 2013, Science.

[37]  Yoichi Sato,et al.  Shape-Preserving Half-Projective Warps for Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  King-To Ng,et al.  A virtual reality system using the concentric mosaic: construction, rendering, and data compression , 2005, IEEE Transactions on Multimedia.

[39]  Zhi Zhang,et al.  An Accurate Multi-Row Panorama Generation Using Multi-Point Joint Stitching , 2018, IEEE Access.

[40]  Andrew W. Fitzgibbon,et al.  A rational function lens distortion model for general cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Jane You,et al.  Hyperspectral image unsupervised classification by robust manifold matrix factorization , 2019, Inf. Sci..

[42]  吴凡路 Wu Fanlu,et al.  Deep Space Exploration Panoramic Camera Calibration Technique Based on Circular Markers , 2013 .

[43]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[44]  Chong-Wah Ngo,et al.  Motion analysis and segmentation through spatio-temporal slices processing , 2003, IEEE Trans. Image Process..

[45]  Juha Suomalainen,et al.  A Lightweight Hyperspectral Mapping System and Photogrammetric Processing Chain for Unmanned Aerial Vehicles , 2014, Remote. Sens..

[46]  Hong Wei,et al.  Correction of image radial distortion based on division model , 2017 .

[47]  Tianzhu Xiang,et al.  Image Stitching by Line-guided Local Warping with Global Similarity Constraint , 2017, Pattern Recognit..

[48]  Pu Miao,et al.  Low-Complexity Path Planning Algorithm for Unmanned Aerial Vehicles in Complicated Scenarios , 2018, IEEE Access.