Video stabilization for a hand-held camera based on 3D motion model

In this paper, a video stabilization technique is presented. There are four steps in the proposed approach. We begin with extracting feature points from the input image using the Lowe SIFT (Scale Invariant Feature Transform) point detection technique. This set of feature points is then matched against the set of feature points detected in the previous image using the Wyk et al. RKHS (Reproducing Kernel Hilbert Space) graph matching technique. We can calculate the camera motion between the two images with the aid of a 3D motion model. Expected and unexpected components are separated using a motion taxonomy method. Finally, a full-frame technique to fill up blank image areas is applied to the transformed image.

[1]  Margrit Betke,et al.  Recognition, Resolution, and Complexity of Objects Subject to Affine Transformations , 2001, International Journal of Computer Vision.

[2]  Jyh-Yeong Chang,et al.  Digital image translational and rotational motion stabilization using optical flow technique , 2002, IEEE Trans. Consumer Electron..

[3]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[4]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Rama Chellappa,et al.  Fast Electronic Digital Image Stabilization for Off-Road Navigation , 1996, Real Time Imaging.

[6]  Tariq S. Durrani,et al.  A RKHS Interpolator-Based Graph Matching Algorithm , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Sei-Wang Chen,et al.  Video stabilization for a camcorder mounted on a moving vehicle , 2004, IEEE Transactions on Vehicular Technology.

[9]  Guangyou Xu,et al.  A stable vision system for moving vehicles , 2000, IEEE Trans. Intell. Transp. Syst..

[10]  Xinggang Lin,et al.  Digital image stabilization based on circular block matching , 2006, IEEE Transactions on Consumer Electronics.

[11]  Azriel Rosenfeld,et al.  Image Sequence Stabilization in Real Time , 1996, Real Time Imaging.