Implementing Planar Motion Tracking Algorithms on CMOS+FPGA Vision System

This paper describes a 1,000 Hz visual feedback using the CMOS+FPGA vision. It is required to obtain positional and angular signals around 1,000 Hz to control a mechanical system. A vision sensor must obtain visual features of a target object, synchronizing its sampling rate to the sampling rate of the control. Thus, we need 1) image capturing over 1,000 Hz with high resolution, 2) visual feature computation at the capturing rate, and 3) visual feature transmission to a control system with little delay. We propose the CMOS+FPGA vision system to realize 1,000 Hz visual feedback. This system consists of a CMOS image detector to capture images at 1,000 Hz and an FPGA to compute image features at this sampling rate. We implement two vision algorithms to track planar motion on the CMOS+FPGA vision system. First we introduce the CMOS+FPGA vision system. Second, we show the implementation of the computation of the image gravity center. Then, we show the implementation of matched filter

[1]  Fumitoshi Matsuno,et al.  Proportional derivative and strain (PDS) boundary feedback control of a flexible space structure with a closed-loop chain mechanism , 2002, Autom..

[2]  Aggelos K. Katsaggelos,et al.  Analysis and FPGA Implementation of Image Restoration under Resource Constraints , 2003, IEEE Trans. Computers.

[3]  George L. Turin,et al.  An introduction to digital matched filters , 1976 .

[4]  Masanori Hariyama,et al.  VLSI processor for reliable stereo matching based on adaptive window-size selection , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Masayuki Inaba,et al.  Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[6]  Shuzhi Sam Ge,et al.  Improving joint PD control of single-link flexible robots by strain/tip feedback , 1996, Proceeding of the 1996 IEEE International Conference on Control Applications IEEE International Conference on Control Applications held together with IEEE International Symposium on Intelligent Contro.

[7]  Jan-Erik Eklund,et al.  VLSI implementation of a focal plane image processor-a realization of the near-sensor image processing concept , 1996, IEEE Trans. Very Large Scale Integr. Syst..

[8]  Idaku Ishii,et al.  A digital vision chip specialized for high-speed target tracking , 2003 .

[9]  W. Yang,et al.  A reconfigurable VLSI coprocessing system for the block matching algorithm , 1997, IEEE Trans. Very Large Scale Integr. Syst..

[10]  Thompson Fourier Transforms in VLSI , 1983, IEEE Transactions on Computers.

[11]  Roger F. Woods,et al.  Applying an XC6200 to Real-Time Image Processing , 1998, IEEE Des. Test Comput..

[12]  Masatoshi Ishikawa,et al.  Target tracking algorithm for 1 ms visual feedback system using massively parallel processing , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[13]  Hossam A. ElGindy,et al.  High-speed Parameterisable Hough Transform Using Reconfigurable Hardware , 2001, VIP.