Realtime and Robust Motion Tracking by Matched Filter on CMOS+FPGA Vision System

This paper describes realtime and robust tracking of a planar motion target by matched filter implemented on the CMOS+FPGA vision system. It is required to obtain positional and angular signals around 1,000 Hz to control a mechanical system. A vision sensor must obtain visual features of a target object, synchronizing its sampling rate to the sampling rate of the control. The CMOS+FPGA vision system has been proposed to realize 1,000 Hz visual feedback. Matched filter can compute the position of a target robustly against occlusion, change of illumination, and background texture but requires much computation time since it includes 2D Fourier transform of images. Thus, matched filter algorithm is implemented on the system so that the matched filter can be performed in realtime. First we briefly introduce the CMOS+FPGA vision system. Second, we summarize the algorithm of matched filter to describe the design of the circuit performing matched filter on an FPGA. Finally, we show the experimental results of planar motion tracking by matched filter implemented on the system.

[1]  Aggelos K. Katsaggelos,et al.  Analysis and FPGA Implementation of Image Restoration under Resource Constraints , 2003, IEEE Trans. Computers.

[2]  George L. Turin,et al.  An introduction to digital matched filters , 1976 .

[3]  Shuzhi Sam Ge,et al.  Improving joint PD control of single-link flexible robots by strain/tip feedback , 1996, Proceeding of the 1996 IEEE International Conference on Control Applications IEEE International Conference on Control Applications held together with IEEE International Symposium on Intelligent Contro.

[4]  Jan-Erik Eklund,et al.  VLSI implementation of a focal plane image processor-a realization of the near-sensor image processing concept , 1996, IEEE Trans. Very Large Scale Integr. Syst..

[5]  Roger F. Woods,et al.  Applying an XC6200 to Real-Time Image Processing , 1998, IEEE Des. Test Comput..

[6]  Fumitoshi Matsuno,et al.  Proportional derivative and strain (PDS) boundary feedback control of a flexible space structure with a closed-loop chain mechanism , 2002, Autom..

[7]  Idaku Ishii,et al.  A digital vision chip specialized for high-speed target tracking , 2003 .

[8]  Masayuki Inaba,et al.  Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[9]  Masanori Hariyama,et al.  VLSI processor for reliable stereo matching based on adaptive window-size selection , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[10]  Hossam A. ElGindy,et al.  High-speed Parameterisable Hough Transform Using Reconfigurable Hardware , 2001, VIP.

[11]  W. Yang,et al.  A reconfigurable VLSI coprocessing system for the block matching algorithm , 1997, IEEE Trans. Very Large Scale Integr. Syst..

[12]  Thompson Fourier Transforms in VLSI , 1983, IEEE Transactions on Computers.

[13]  Masatoshi Ishikawa,et al.  Target tracking algorithm for 1 ms visual feedback system using massively parallel processing , 1996, Proceedings of IEEE International Conference on Robotics and Automation.