Hybrid super resolution using refined face logs

Super resolution algorithms are necessary for improving the quality of low resolution video sequences from surveillance cameras. These algorithms have two main problems: first, they hardly can improve the quality of their inputs by factors bigger than two. Second, applying them to real video sequences usually produces unstable and noisy output. The proposed system in this paper deals with these two problems. The latter, which is due to the unavoidable registration errors of video sequences, is dealt with by using a face quality assessment technique. A combination of different types of super resolution algorithms in a hybrid system is used to cope with the former. The system is tested using real world videos from uncontrolled environments and the results are promising.

[1]  Francisco de Borja Rodríguez Ortiz,et al.  A two-step neural-network based algorithm for fast image super-resolution , 2007, Image Vis. Comput..

[2]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Thomas B. Moeslund,et al.  Complete face logs for video sequences using face quality measures , 2009 .

[4]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[5]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for surveillance images , 2010, Signal Process..

[6]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[7]  Thomas B. Moeslund,et al.  Face Quality Assessment System in Video Sequences , 2008, BIOID.

[8]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[10]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[11]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[12]  Yizhen Huang,et al.  Super-resolution using neural networks based on the optimal recovery theory , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[13]  Shmuel Peleg,et al.  Two motion-blurred images are better than one , 2005, Pattern Recognit. Lett..

[14]  Vivek Bannore,et al.  Iterative-Interpolation Super-Resolution Image Reconstruction - A Computationally Efficient Technique , 2009, Studies in Computational Intelligence.

[15]  Frank P. Ferrie,et al.  Comparison of Super-Resolution Algorithms Using Image Quality Measures , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[16]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[17]  Dattatraya S. Bormane,et al.  Super Resolution Using Neural Network , 2008, 2008 Second Asia International Conference on Modelling & Simulation (AMS).