Tracking , Segmentation and Optical Flow

Two difficult issues in optical flow are motion discontinuities and large interframe motion. We present an algorithm that addresses both issues by first performing feature tracking and motion segmentation and then warping one of the images to reduce the interframe motion and avoid the motion discontinuities. The algorithm consists of three major phases: 1) feature selection, 2) feature tracking and segmentation 3) optical flow. We used the Lucas and Kanade algorithm to compute the flow. The experiments on real images as well as synthetic images with ground truth showed that this method is very accurate. Ke ywords: Motion, Segmentation, Tracking, Optical Flow

[1]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[2]  Peter J. Burt,et al.  Object tracking with a moving camera , 1989, [1989] Proceedings. Workshop on Visual Motion.

[3]  Pietro Perona,et al.  Real-time 2-D feature detection on a reconfigurable computer , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  A. Murat Tekalp,et al.  Motion segmentation by multistage affine classification , 1997, IEEE Trans. Image Process..

[6]  Michael J. Black,et al.  Mixture models for optical flow computation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[8]  Jake K. Aggarwal,et al.  A new Bayesian relaxation framework for the estimation and segmentation of multiple motions , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[9]  金谷 健一.  Statistical optimization for geometric computation : theory and practice , 2005 .

[10]  David J. Fleet,et al.  Robust online appearance models for visual tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Stephen M. Smith,et al.  ASSET-2: Real-Time Motion Segmentation and Shape Tracking , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Kenichi Kanatani,et al.  Motion segmentation by subspace separation and model selection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Michal Irani,et al.  Computing occluding and transparent motions , 1994, International Journal of Computer Vision.

[14]  Takeo Kanade,et al.  A multi-body factorization method for motion analysis , 1995, Proceedings of IEEE International Conference on Computer Vision.