Study on multiple image processing hardware system based on DSP

This paper presents the hardware system scheme of multi-channel image processing based on DSP, with DSP as the core control of FPGA and CMOS, responsible for the overall scheduling system, using FPGA as coprocessor responsible for the collection of the original image information from CMOS. This paper combines the fisheye lens to obtain the complete original image for panoramic vision and stereo vision requirement. FPGA is used to design the SRAM cache controller based on Ping-pong mechanism. The data exchanging between DSP and FPGA are completed in EDMA model of DSP. Asynchronous FIFO is applied to solve the problem of cross clock domain. Experiments show that the system can be realized in the image data acquisition speed of 45 frames per second and the output of PAL style distortion fisheye image.

[1]  Shi Zhong-ke.  Ping-pang buffering and its application in real-time video acquisition based on DSP , 2008 .

[2]  Dah-Jye Lee,et al.  Dense Disparity Real-Time Stereo Vision Algorithm for Resource-Limited Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Guo Yong-cai.  Embedded image system based on DM642 , 2008 .

[4]  Kenji Terabayashi,et al.  Measurement of Three-Dimensional Environment with a Fish-Eye Camera Based on Structure from Motion - Error Analysis , 2009, J. Robotics Mechatronics.

[5]  Liu Hong.  Design and implementation of video image acquisition and data processing system based on DSP , 2009 .

[6]  Yin Hang.  Design of high-speed asynchronous FIFO memory based on VHDL , 2007 .

[7]  Jan Heller,et al.  Stereographic rectification of omnidirectional stereo pairs , 2009, CVPR.

[8]  Cheng Tao-bo.  Omni-Directional Image Making Based on Fisheye Lens , 2010 .

[9]  Bin Wang,et al.  High-Speed Data Communication Between DSP and FPGA in Embedded Panoramic Video Processing System: High-Speed Data Communication Between DSP and FPGA in Embedded Panoramic Video Processing System , 2010 .

[10]  Ma Le.  General image processing system design and implementation based on Stratix IV , 2012 .

[11]  Pierre Miché,et al.  Implementation of a 3D Vision System on DSPs TMS320C31 , 2000, Real Time Imaging.

[12]  Michal Havlena,et al.  Structure from Omnidirectional Stereo Rig Motion for City Modeling , 2008, VISAPP.

[13]  Beijing Beijing,et al.  IEEE International Conference on Mechatronics and Automation , 2015 .

[14]  Shigang Li,et al.  Full-View Spherical Image Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Michael D. Naish,et al.  Developing a Modular Active Spherical Vision System , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  Zhigang Zhu.  Omnidirectional Stereo Vision , 2001 .

[17]  Ren Dexue.  Design of CMOS image capture system based on TMS320DM642 , 2008 .