Multiframe adaptive Wiener filter super-resolution with JPEG2000-compressed images

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe super-resolution (SR) image processing techniques have evolved separately. In this paper, we propose and compare novel processing architectures for applying multiframe SR with JPEG2000 compression. We propose a modified adaptive Wiener filter (AWF) SR method and study its performance as JPEG2000 is incorporated in different ways. In particular, we perform compression prior to SR and compare this to compression after SR. We also compare both independent-frame compression and difference-frame compression approaches. We find that some of the SR artifacts that result from compression can be reduced by decreasing the assumed global signal-to-noise ratio (SNR) for the AWF SR method. We also propose a novel spatially adaptive SNR estimate for the AWF designed to compensate for the spatially varying compression artifacts in the input frames. The experimental results include the use of simulated imagery for quantitative analysis. We also include real-video results for subjective analysis.

[1]  Aggelos K. Katsaggelos,et al.  Region-based super-resolution for compression , 2007, Multidimens. Syst. Signal Process..

[2]  R. Fiete.  Image quality and λFN/p for remote sensing systems , 1999 .

[3]  Zhiwei Xiong,et al.  Robust Web Image/Video Super-Resolution , 2010, IEEE Transactions on Image Processing.

[4]  Russell Hardie.  High Resolution Image Reconstruction: High Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames. , 1996 .

[5]  Ci Wang,et al.  Down-Sampling Based Video Coding Using Super-Resolution Technique , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Yuan Jie,et al.  Super-resolution reconstruction of image sequences compressed with DWT-based techniques , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[7]  Kannappan Palaniappan,et al.  Super-resolution mosaics from airborne video using robust gradient regularization , 2013, Defense, Security, and Sensing.

[8]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[9]  Russell C Hardie,et al.  Fast super-resolution using an adaptive Wiener filter with robustness to local motion. , 2012, Optics express.

[10]  Barak Fishbain,et al.  Real-time turbulent video super-resolution using MPEG-4 , 2008, Electronic Imaging.

[11]  Debargha Mukherjee,et al.  Super resolution of video using key frames , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[12]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[13]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2013, The Kluwer international series in engineering and computer science.

[14]  Zhiwei Xiong,et al.  Super-resolution for low quality thumbnail images , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[15]  Ciza Thomas.  SENSOR FUSION AND ITS APPLICATIONS , 2016 .

[16]  Addisson Salazar,et al.  Optimum Detection of Ultrasonic Echoes Applied to the Analysis of the First Layer of a Restored Dome , 2007, EURASIP J. Adv. Signal Process..

[17]  Moon Gi Kang,et al.  Super-resolution image reconstruction , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[18]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[19]  Mohammad S. Alam,et al.  Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames , 2000, IEEE Trans. Instrum. Meas..

[20]  Raul Ordonez,et al.  Fast super-resolution with affine motion using an adaptive Wiener filter and its application to airborne imaging. , 2011, Optics express.

[21]  Qiang He,et al.  Super-Resolution Reconstruction by Image Fusion and Application to Surveillance Videos Captured by Small Unmanned Aircraft Systems , 2010 .

[22]  Yücel Altunbasak,et al.  Super-resolution reconstruction of compressed video using transform-domain statistics , 2004, IEEE Transactions on Image Processing.

[23]  Aggelos K. Katsaggelos,et al.  Toward a new video compression scheme using super-resolution , 2006, Electronic Imaging.

[24]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[25]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[26]  Kenneth E. Barner,et al.  Super-Resolution Enhancement of Digital Video , 2007, EURASIP J. Adv. Signal Process..

[27]  Mark R. Pickering,et al.  A transform-domain approach to super-resolution mosaicing of compressed images , 2008 .

[28]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.