Super-resolution imaging applied to moving targets in high dynamics scenes

In modern tracking systems the ability to obtain high quality, high resolution appearance of the tracked target is often highly desirable. However, the reality of operational deployment often means that imaging systems deployed for this task suffer from limitations reducing effective image quality. These limitations can be attributed to a range of causes such as low quality video sensors, system noise, high target dynamics and other environmental noise factors. Despite the advantages of the super-resolution techniques the problem of handling complex motion still remains a challenging task for the effective super-resolution implementation. The computational complexity and large memory requirements required for the implementation of super-resolution imaging largely restrict the usage of these techniques in real-time hardware implementations. In order to improve visual quality of the tracked target and overcome these limitations, we propose a simple yet effective solution that integrates a super-resolution imaging approach based on combination of the Sum of the Absolut Differences (SAD) and gradient-descent motion estimation techniques into a novel tracking approach. In addition, the proposed approach demonstrates robustness in improved target appearance modeling that assists the overall tracking system. The presented results demonstrate this significant improvement in visual target representation whilst tracking over high dynamic scenes. The implementation simplicity of the proposed approach makes it an attractive solution for realization on low power hardware. Such a system can be deployed on small unmanned aerial vehicles (UAV) or other hardware where size, weight and power (SWaP) is of a particular concern.

[1]  Peyman Milanfar,et al.  Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement , 2001, IEEE Trans. Image Process..

[2]  周鑫,et al.  Tracking-learning-detection (TLD)-based video object tracking method , 2012 .

[3]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[4]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[5]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[6]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[7]  Robert L. Stevenson,et al.  Spatial Resolution Enhancement of Low-Resolution Image Sequences A Comprehensive Review with Directions for Future Research , 1998 .

[8]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[9]  Raul Ordonez,et al.  Fast super-resolution with affine motion using an adaptive Wiener filter and its application to airborne imaging. , 2011, Optics express.

[10]  Sung-Bong Yang,et al.  An efficient search algorithm for BLOCK motion estimation , 1999, 1999 IEEE Workshop on Signal Processing Systems. SiPS 99. Design and Implementation (Cat. No.99TH8461).

[11]  Kalyan Moy Gupta,et al.  A comparative evaluation of anomaly detection algorithms for maritime video surveillance , 2011, Defense + Commercial Sensing.

[12]  Toby P. Breckon,et al.  Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab , 2011 .

[13]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .