Placement of Full Motion Video (FMV) frames in geographic context using pursuer

When viewing full motion video (FMV) from an unmanned aerial vehicle, the "context" of the video (the location and orientation of objects within the video) is often as important to the end-user as the video itself. To provide context to video being collected in real-time, we have developed a system for placing frames from a FMV stream in a geographic context. As a visualization platform, we utilize Pursuer, a US Air Force "government-o-the- shelf" system based on NASA's World Wind software package. Pursuer provides an intuitive interface for viewing several dierent layers of imagery, including pre-existing maps, reference imagery, and recently collected imagery, all placed within geographical context (similar to Google Earth). The focus of this paper is the technology developed for creating a Pursuer layer for FMV streams. We present results obtained from small UAV ights in Florida and New York and discuss needed future improvements.

[1]  Joshua D. Redding,et al.  Vision-based target localization from a fixed-wing miniature air vehicle , 2006, 2006 American Control Conference.

[2]  Supun Samarasekera,et al.  Registration of highly-oblique and zoomed in aerial video to reference imagery , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Penggen Cheng,et al.  Unmanned aerial vehicle (UAV) real-time video registration for forest fire monitoring , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[4]  Clark N. Taylor,et al.  An automatic system for creating geo-referenced mosaics from MAV video , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Harpreet S. Sawhney,et al.  Registration of video to geo-referenced imagery , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[6]  Clark N. Taylor,et al.  Creation of geo-referenced mosaics from MAV video and telemetry using constrained optimization bundle adjustment , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.