Multiple-frames super-resolution for closed circuit television forensics

CCTV forensics is a very challenging task as video files seized from a CCTV DVR can be in a detrimental state with bad lighting ambience, noise, blurring due to optical settings and motion, compression artifacts, interlaces and low-resolved frame size to name a few. This always results in the difficulties in analyzing subjects in the video which are subjected to investigation. We present a multiple-frames Super-Resolution technique by combining a sequence of video frames of a subject in order to create a super-resolved frame of the subject with increased resolution and clarities. For that purpose, we used Projection onto Convex Sets (POCS) method for the super-resolution. For estimating the shift and rotational parameters of frames for the POCS we used Keren for that purpose. This process is tested with real footage of CCTV video which we did simulation on a crime scene. From the experiments we conducted, the results found are far exceeding in quality than conventional image resampling methods.

[1]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Zhiwei Xiong,et al.  Robust Web Image/Video Super-Resolution , 2010, IEEE Transactions on Image Processing.

[3]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[6]  Sean Borman,et al.  Topics in Multiframe Superresolution Restoration , 2004 .

[7]  Eamon B. Barrett,et al.  Super-resolution image synthesis using projections onto convex sets in the frequency domain , 2005, IS&T/SPIE Electronic Imaging.

[8]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[9]  Xiaoming Liu,et al.  Multi-Frame Super-Resolution for Face Recognition , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[10]  Na Fan,et al.  Super-Resolution Using Regularized Orthogonal Matching Pursuit Based on Compressed Sensing Theory in the Wavelet Domain , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[11]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[12]  Guoqiang Han,et al.  Map-Based Single-Frame Super-Resolution Image Reconstruction for License Plate Recognition , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[13]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[14]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[15]  P. Vandewalle Super-resolution from unregistered aliased images , 2006 .