SaVE: sensor-assisted motion estimation for efficient h.264/AVC video encoding

Motion estimation is a key component of modern video encoding and is very compute-intensive. We present a novel Sensor-assisted Video Encoding (SaVE) method to reduce the computational complexity of motion estimation in H.264/AVC encoders, leveraging accelerometers and digital compasses that are increasingly available on mobile devices. Using these sensors, SaVE calculates the rotational movement of a camera and then infers the global motion in the camera image sensor; it subsequently employs the estimated global motion to simplify the state-of-the-art motion estimation algorithms, UMHS and EPZS used in H.264/AVC encoders. We have constructed a prototype of SaVE and report extensive evaluation of it. Our experimental results show that SaVE can reduce the computations of UMHS and EPZS algorithms by up to 27% and 18%, respectively, while achieving the same or better video quality.

[1]  C. Cheung,et al.  Normalized partial distortion search algorithm for block motion estimation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[2]  Oscar C. Au,et al.  Predictive motion vector field adaptive search technique (PMVFAST): enhancing block-based motion estimation , 2000, IS&T/SPIE Electronic Imaging.

[3]  Lai-Man Po,et al.  A novel kite-cross-diamond search algorithm for fast block matching motion estimation , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[4]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[5]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Jianfeng Xu,et al.  Fast integer-pel and fractional-pel motion estimation for H.264/AVC , 2006, J. Vis. Commun. Image Represent..

[7]  Jae-Kyoon Kim,et al.  A new fast local motion estimation algorithm using global motion , 1998, Signal Process..

[8]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  Lai-Man Po,et al.  A novel cross-diamond search algorithm for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[11]  Bede Liu,et al.  New fast algorithms for the estimation of block motion vectors , 1993, IEEE Trans. Circuits Syst. Video Technol..

[12]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[13]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[14]  Dirk Adolph,et al.  1.15 Mbit/s coding of video signals including global motion compensation , 1991, Signal Process. Image Commun..

[15]  Jhing-Fa Wang,et al.  Dynamic search-window adjustment and interlaced search for block-matching algorithm , 1993, IEEE Trans. Circuits Syst. Video Technol..

[16]  Ahmad Rahmati,et al.  SenseCoding: accelerometer-assisted motion estimation for efficient video encoding , 2008, ACM Multimedia.

[17]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Lai-Man Po,et al.  Adjustable partial distortion search algorithm for fast block motion estimation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  Hiroshi Watanabe,et al.  Two-stage motion compensation using adaptive global MC and local affine MC , 1997, IEEE Trans. Circuits Syst. Video Technol..

[20]  Stefan Eckart,et al.  ISO-IEC MPEG-2 software video codec , 1995, Electronic Imaging.