Sparse representation super-resolution method for enhancement analysis in video forensics

The enhancement analysis in video forensics is used to enhance the clarity of video frames of a video exhibit. The enhanced version of these video frames is important as to assist law enforcement agency for investigation or to be tended as evidence in court. The most significant problem observed in the analysis is the enhancement of objects under probe in video. In many cases, the probes appeared to be in low-resolution and degraded with noise, lens blur and compression artifacts. The enhancement of these low quality probes via conventional method of denoising and resizing has proven to further degrade the quality of the prober The objective of this paper is to propose an enhancement analysis algorithm based on super-resolution. Hence, we present an solution which is a single-frame solution for super-resolution. For that purpose, our proposed method incorporates sparse coding with Non-Negative Matrix Factorization in order to improve hallucination of probes in video. Sparse coding is employed in learning a localized part-based subspace which synthesizes higher resolution with respect to overcomplete patch dictionaries. We test our proposed method and compare with state-of-the-art methods namely resampling and super-resolution method, by enhancing probes in exhibit videos. We measure the image quality using peak-signal-to-noise-ratio. The result shows that our proposed method outperforms state-of the-art methods after enhancing probes in exhibit videos.

[1]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[2]  Jan Flusser,et al.  A Unified Approach to Superresolution and Multichannel Blind Deconvolution , 2007, IEEE Transactions on Image Processing.

[3]  Shahrin Azuan Nazeer,et al.  Image Quality Assessments and Restoration for Face Detection and Recognition System Images , 2008, 2008 Second Asia International Conference on Modelling & Simulation (AMS).

[4]  Siti Norul Huda Sheikh Abdullah,et al.  Multiple-frames super-resolution for closed circuit television forensics , 2011, 2011 International Conference on Pattern Analysis and Intelligence Robotics.

[5]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Harry Shum,et al.  Face Hallucination: Theory and Practice , 2007, International Journal of Computer Vision.

[8]  Sridha Sridharan,et al.  Soft-Biometrics: Unconstrained Authentication in a Surveillance Environment , 2009, 2009 Digital Image Computing: Techniques and Applications.

[9]  Eamon B. Barrett,et al.  Super-resolution image synthesis using projections onto convex sets in the frequency domain , 2005, IS&T/SPIE Electronic Imaging.

[10]  William T. Freeman,et al.  A High-Quality Video Denoising Algorithm Based on Reliable Motion Estimation , 2010, ECCV.

[11]  Xiaoming Liu,et al.  Multi-Frame Image Restoration for Face Recognition , 2007 .