A resolution enhancement algorithm for an asymmetric resolution stereo video

This paper presents a resolution enhancement algorithm in an asymmetric resolution stereo video for improving the video resolution. In this stereo video architecture, a scene is captured by two cameras to form two views, one view is a lower-resolution video and the other is a full-resolution video. The goal is to enhance the lower-resolution video to a full-resolution video. In the lower-resolution video, frames synchronized with full-resolution video are enhanced via disparity estimation algorithm, while the rest frames are improved by mono-view video super-resolution based on key frames method. The experimental results demonstrate that the proposed method is effective for both visual and objective qualities.

[1]  Jing Zhang,et al.  A simultaneous method for 3D video super-resolution and high-quality depth estimation , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Edson M. Hung,et al.  Video Super-Resolution Using Codebooks Derived From Key-Frames , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..

[4]  Ju Liu,et al.  A Robust Video Super-resolution Based on Adaptive Overlapped Block Motion Compensation , 2013, 2013 International Conference on Signal-Image Technology & Internet-Based Systems.

[5]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[6]  Byung Cheol Song,et al.  Video deblurring based on bidirectional motion compensation and accurate blur kernel estimation , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Debargha Mukherjee,et al.  Super-resolution of video using key frames and motion estimation , 2008, 2008 15th IEEE International Conference on Image Processing.

[8]  V. Asari,et al.  Super-resolution enhancement technique for low resolution video , 2010, IEEE Transactions on Consumer Electronics.

[9]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[10]  Zhenyu Liu,et al.  Asymmetric stereoscopic image resolution enhancement , 2011, The First Asian Conference on Pattern Recognition.

[11]  Byung Cheol Song,et al.  Key frame-based video super-resolution using bi-directional overlapped block motion compensation and trained dictionary , 2010, 2010 2nd International Conference on Image Processing Theory, Tools and Applications.

[12]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Federico Tombari,et al.  Segmentation-Based Adaptive Support for Accurate Stereo Correspondence , 2007, PSIVT.

[14]  Ju Liu,et al.  Key frames-based video super-resolution using adaptive overlapped block motion compensation , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[15]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[16]  Richard Chbeir,et al.  Signal Image Technology & Internet-based Systems , 2006, J. Digit. Inf. Manag..

[17]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[18]  Shahram Shirani,et al.  Regularization function for video super-resolution using auxiliary high resolution still images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[19]  Sang Uk Lee,et al.  Mutual information-based stereo matching combined with SIFT descriptor in log-chromaticity color space , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Cosmin Ancuti,et al.  Video super-resolution using high quality photographs , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Truong Q. Nguyen,et al.  Video super-resolution for mixed resolution stereo , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Sang Uk Lee,et al.  Mutual information-based stereo matching combined with SIFT descriptor in log-chromaticity color space , 2009, CVPR.

[24]  Ci Wang,et al.  Down-Sampling Based Video Coding Using Super-Resolution Technique , 2011, IEEE Transactions on Circuits and Systems for Video Technology.