A local feature based compensation scheme for unsmooth video coding

In this paper, a local feature based compensation scheme is proposed for unsmooth video coding. Unlike natural video sequences, video sequences captured by mobile device, often have unsmooth changes, which makes the scene content have a sharp change in geometric deformation and photometric transformation. Unfortunately, the unsmooth changes are often difficult to be reduced by block motion compensation. Different from the method used in the traditional video coding scheme, this paper proposes a novel local feature based compensation scheme utilizing the technology of multi-reference frames motion compensation. Firstly the geometric distortions are eliminated through geometric model estimation utilizing the correlations between the current encoding frame and the frames in reference buffers. Then we obtain the deformed prediction frame through the photometric transformation module to compensate the illumination changes. Finally, the predicted frames are substituted into the reference buffers for video encoding. Experiments show that the proposed method can achieve better video quality with lower stream compared with the traditional method.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Hsueh-Ming Hang,et al.  Motion Estimation for Video Coding Standards , 1997, J. VLSI Signal Process..

[3]  Mohan S. Kankanhalli,et al.  Detection and removal of lighting & shaking artifacts in home videos , 2002, MULTIMEDIA '02.

[4]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  Tien-Ying Kuo,et al.  Fast Multiple Reference Frame Motion Estimation for H.264 Based on Qualified Frame Selection Scheme , 2005, KES.

[8]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ming-Ting Sun,et al.  Fast multiple reference frame motion estimation for H.264/AVC , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  U. Singh,et al.  An Overview on: Image Alignment & Open Issues , 2012 .

[11]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Xiaoyan Sun,et al.  Photo Album Compression for Cloud Storage Using Local Features , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.