Fast and accurate global motion estimation algorithm using pixel subsampling

Global motion generally describes the motion of a camera, although it may comprise motions of large objects. Global motions are often modeled by parametric transformations of two-dimensional images. The process of estimating the motions parameters is called global motion estimation (GME). GME is widely employed in many applications such as video coding, image stabilization and super-resolution. To estimate global motion parameters, the Levenburg-Marquardt algorithm (LMA) is typically used to minimize an objective function iteratively. Since the region of support for the global motion representation consists of the entire image frame, the minimization process tends to be very expensive computationally by involving all the pixels within an image frame. In order to significantly reduce the computational complexity of the LMA, we proposed to select only a small subset of the pixels for estimating the motion parameters, based on several subsampling patterns and their combinations. Simulation results demonstrated that the proposed method could speed up the conventional GME approach by over ten times, with only a very slight loss (less than 0.1dB) in estimation accuracy. The proposed method was also found to outperform several state-of-the-art fast GME methods in terms of the speed/accuracy tradeoffs.

[1]  Rama Chellappa,et al.  Evaluation of image stabilization algorithms , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[2]  Chi-Cheng Cheng,et al.  Acquisition of translational motion by the parallel trinocular , 2008, Inf. Sci..

[3]  Bede Liu,et al.  New fast algorithms for the estimation of block motion vectors , 1993, IEEE Trans. Circuits Syst. Video Technol..

[4]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[5]  Seong-Moo Yoo,et al.  Efficient local transformation estimation using Lie operators , 2007, Inf. Sci..

[6]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[7]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[8]  Arun K. Majumdar,et al.  Video model for dynamic objects , 2006, Inf. Sci..

[9]  Wan-Chi Siu,et al.  Fast global motion estimation for sprite generation , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[10]  Amir Averbuch,et al.  Fast gradient methods based global motion estimation for video compression , 2002, Proceedings. International Conference on Image Processing.

[11]  Yu-Chun Peng,et al.  Integration of Digital Stabilizer With Video Codec for Digital Video Cameras , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Fabio Gagliardi Cozman,et al.  Fast software image stabilization with color registration , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[13]  Miyoung Kim,et al.  Global Motion Estimation in Sprite Generation by Eliminating Local Object Motions , 2003, IbPRIA.

[14]  Amir Averbuch,et al.  Multisensor image registration via implicit similarity , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Amir Averbuch,et al.  Fast gradient methods based on global motion estimation for video compression , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Demin Wang,et al.  Global motion parameters estimation using a fast and robust algorithm , 1997, IEEE Trans. Circuits Syst. Video Technol..

[17]  Tihao Chiang,et al.  A hierarchical N-Queen decimation lattice and hardware architecture for motion estimation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Michael T. Heath,et al.  Scientific Computing , 2018 .

[19]  Liang-Gee Chen,et al.  Hardware architecture for global motion estimation for MPEG-4 Advanced Simple Profile , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[20]  Wan-Chi Siu,et al.  Robust global motion estimation and novel updating strategy for sprite generation , 2007 .

[21]  Michael T. Heath,et al.  Scientific Computing: An Introductory Survey , 1996 .

[22]  Yui-Lam Chan,et al.  New adaptive pixel decimation for block motion vector estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[23]  C. Stiller,et al.  Estimating motion in image sequences , 1999, IEEE Signal Process. Mag..

[24]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[25]  Aljoscha Smolic,et al.  Low-complexity global motion estimation from P-frame motion vectors for MPEG-7 applications , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).