Near Real-Time Orthorectification and Mosaic of Small UAV Video Flow for Time-Critical Event Response

A method for real-time mosaic of video flow acquired by a small low-cost unmanned aerial vehicle (UAV) has been presented in this paper. The basic procedures of real-time mosaic are as follows: (1) Each video frame is resampled and orthorectified using a developed mathematical model, which can simultaneously solve the video camera's interior orientation parameters and the exterior orientation parameters of each video frame; (2) each orthorectified video frame is mosaicked at real time. A test field located in Picayune, Mississippi, has been established for testing our method. Sixty-minute video data were collected using the UAV and were processed using the proposed method. The results demonstrated that each video frame can be geo-orthorectified and mosaicked together to produce a 2-D planimetric mapping at near real time. Accuracy of the mosaicked video images (2-D planimetric map) is approximately 1-2 pixels, when compared to 55 checkpoints, which were measured by differential GPS surveying.

[1]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[2]  M. Cannon,et al.  An integrated INS/GPS approach to the georeferencing of remotely sensed data , 1993 .

[3]  Jan Skaloud,et al.  Exterior Orientation By Direct Measurement Of Camera Position And Attitude , 1996 .

[4]  Francis L. Merat,et al.  THREE-DIMENSIONAL CAMERA CALIBRATION TECHNIQUE FOR STEREO IMAGING VELOCIMETRY EXPERIMENTS , 1997 .

[5]  John K. Pollard,et al.  Accurate geometric correction of ATSR images , 1997, IEEE Trans. Geosci. Remote. Sens..

[6]  M. Simard,et al.  Classification of the Gabon SAR mosaic using a wavelet based rule classifier , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[7]  Dorota A. Grejner-Brzezinska.  DIRECT EXTERIOR ORIENTATION OF AIRBORNE IMAGERY WITH GPS/INS SYSTEM: PERFORMANCE ANALYSIS. , 1999 .

[8]  Yong Du,et al.  Radiometric normalization, compositing, and quality control for satellite high resolution image mosaics over large areas , 2001, IEEE Trans. Geosci. Remote. Sens..

[9]  D. Stallmann,et al.  SYSTEM CALIBRATION FOR DIRECT GEOREFERENCING , 2002 .

[10]  Kenneth C. Jezek,et al.  Orthorectification of 1960s satellite photographs covering Greenland , 2002, IEEE Trans. Geosci. Remote. Sens..

[11]  Soo Chin Liew,et al.  Producing cloud free and cloud-shadow free mosaic from cloudy IKONOS images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[12]  Stanley R. Herwitz,et al.  UAV Homeland Security Demonstration , 2004 .

[13]  Geoffrey L. Barrows,et al.  Flying insect inspired vision for autonomous aerial robot maneuvers in near-earth environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  Timothy W. McLain,et al.  Initial Experiments in the Cooperative Control of Unmanned Air Vehicles , 2004 .

[15]  Paul Y. Oh.  Flying insect inspired vision for micro-air-vehicle navigation , 2004 .

[16]  D. Gibbins,et al.  A video geo-location and image enhancement tool for small unmanned air vehicles (UAVs) , 2004, Proceedings of the 2004 Intelligent Sensors, Sensor Networks and Information Processing Conference, 2004..

[17]  Eric N. Johnson,et al.  UAV Flight Test Programs at Georgia Tech , 2004 .

[18]  Ted Miles,et al.  "Sensors with Wings" - Small UAVs for Earth Science , 2004 .

[19]  Qamar A. Shams,et al.  Technology Challenges in Small UAV Development , 2005 .

[20]  Isaac Kaminer,et al.  On Vision-Based Target Tracking and Range Estimation for Small UAVs , 2005 .

[21]  Ryan Hruska.  Small UAV-Acquired, High-resolution, Georeferenced Still Imagery , 2005 .

[22]  J. Karl Hedrick,et al.  Hybrid Control for UAV-Assisted Search and Rescue , 2005 .

[23]  Weirong Chen,et al.  A comprehensive study on urban true orthorectification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Peter Strobl,et al.  Monitoring of gas pipelines - a civil UAV application , 2005 .

[25]  Karsten Jacobsen,et al.  Influence of System Calibration on Direct Sensor Orientation , 2005 .

[26]  Yongwei Sheng,et al.  Automated georeferencing and orthorectification of Amazon basin-wide SAR mosaics using SRTM DEM data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Mark Campbell,et al.  A Vision Based Geolocation Tracking System for UAV ’ s , 2006 .

[28]  Paul Y. Oh,et al.  Near-Earth Unmanned Aerial Vehicles: Sensor Suite Testing and Evaluation , 2006 .

[29]  J. Hedrick,et al.  Probabilistic Mapping For UAV using Point-mass Target Detection , 2006 .

[30]  Timothy W. McLain,et al.  Vision-based Target Geo-location using a Fixed-wing Miniature Air Vehicle , 2006, J. Intell. Robotic Syst..

[31]  G. M. Saggiani,et al.  Specific Aspects in the Preliminary Design Process for Small Rotorcraft UAVs , 2006 .

[32]  Eric N. Johnson,et al.  Flight Results of Autonomous Fixed-Wing UAV Transitions to and from Stationary Hover , 2006 .

[33]  Isaac Kaminer,et al.  Vision-Based Tracking and Motion Estimation for Moving Targets Using Small UAVs , 2006 .

[34]  Pierre Soille,et al.  Automated morphological image composition for mosaicing large image data sets , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[35]  V. Chandrasekar,et al.  Real-time three-dimensional radar mosaic in CASA IP1 testbed , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[36]  Sivasankar Ramarasu.  Vision based navigation for an unmanned aerial vehicle , 2007 .