Model-less and model-based computationally efficient motion estimation for video compression in transportation applications

Block-based motion estimation is an important component in many video coding standards that aims at removing temporal redundancy between neighboring frames. Traditional methods for block-based motion estimation such as the Exhaustive Block Matching Algorithm (EBMA) are capable of achieving good matching performance but are computationally expensive. Alternatives to EBMA have been proposed to reduce the amount of search points by trading off matching optimality with computational resources. Although they exploit shared local spatial attributes around the target block, they fail to take advantage of the characteristics of the video sequences acquired with stationary cameras used in transportation and surveillance applications, where motion patterns are largely regularized; often, they also fail to yield semantically meaningful motion vector fields. In this paper, we propose two alternative approaches to improve the efficiency of motion estimation in video compression: (i) a highly efficient model-less approach that estimates the direction and magnitude of motion of objects in the scene and predicts the optimal search direction/neighborhood location for motion vectors; and (ii) a model-based approach that learns the dominant spatiotemporal characteristics of the motion patterns captured in the video via statistical models and enables reduced searches according to the constructed models. We demonstrate via experimental validation that the proposed methods attain computational savings, achieve improved reconstruction error and prediction capabilities for a given search neighborhood size, and yield more semantically meaningful motion vector fields when coupled with traditional motion estimation algorithms.

[1]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[2]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[3]  R. Srinivasan,et al.  Predictive Coding Based on Efficient Motion Estimation , 1985, IEEE Trans. Commun..

[4]  Hsueh-Ming Hang,et al.  An efficient block-matching algorithm for motion-compensated coding , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  M. GHANBARI,et al.  The cross-search algorithm for motion estimation [image coding] , 1990, IEEE Trans. Commun..

[6]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[7]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[8]  Jianhua Lu,et al.  A simple and efficient search algorithm for block-matching motion estimation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[9]  Shen-Chuan Tai,et al.  Fast full-search block-matching algorithm for motion-compensated video compression , 1997, IEEE Trans. Commun..

[10]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..

[11]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[12]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[13]  T. Tsai,et al.  A novel predict hexagon search algorithm for fast block motion estimation on H.264 video coding , 2004, The 2004 IEEE Asia-Pacific Conference on Circuits and Systems, 2004. Proceedings..

[14]  Ivano Barbieri,et al.  Search window size decision for motion estimation algorithm in H.264 video coder , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  M.A. Bayoumi,et al.  Adaptive search window size algorithm for fast motion estimation in H.264/AVC standard , 2005, 48th Midwest Symposium on Circuits and Systems, 2005..

[16]  Henri Nicolas,et al.  Compressed domain aided analysis of traffic surveillance videos , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[17]  Mohammed Golam Sarwer,et al.  An Efficient Search Range Decision Algorithm for Motion Estimation in H.264/AVC , 2009 .

[18]  Iain E. G. Richardson,et al.  The H.264 Advanced Video Compression Standard , 2010 .

[19]  Iain E. Richardson,et al.  The H.264 Advanced Video Compression Standard: Richardson/The H.264 Advanced Video Compression Standard , 2010 .

[20]  Orhan Bulan,et al.  Monocular vision-based vehicular speed estimation from compressed video streams , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[21]  Raja Bala,et al.  Computer vision in roadway transportation systems: a survey , 2013, J. Electronic Imaging.

[22]  Orhan Bulan,et al.  Efficient processing of transportation surveillance videos in the compressed domain , 2013, J. Electronic Imaging.