Efficient feature tracking with application to camera motion estimation

This paper describes a high level design for camera motion estimation and details an efficient implementation of a feature point detection technique known as the "Kanade-Lucas-Tomasi" (KLT) algorithm. After making several novel approximations, an efficient, high-performance field-programmable gate-array (FPGA) design that does not sacrifice detection performance is presented. The high level design couples the FPGA with a conventional digital signal processor to enable full video rate throughput. Results of the FPGA-based feature point detection as well as its application to camera motion estimation are shown.

[1]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Minas E. Spetsakis A linear algorithm for point and line-based structure from motion , 1992, CVGIP Image Underst..

[3]  Scott Hauck,et al.  The Roles of FPGA's in Reprogrammable Systems , 1998 .

[4]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[6]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Eric K. Pauer,et al.  Rapid implementation of mathematical and DSP algorithms in configurable computing devices , 1998, Other Conferences.

[8]  Scott Hauck,et al.  The roles of FPGAs in reprogrammable systems , 1998, Proc. IEEE.

[9]  Ian D. Reid,et al.  The Active Recovery of 3D Motion Trajectories and Their Use in Prediction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..