2D Discrete Fourier Transform with simultaneous edge artifact removal for real-time applications

Two-Dimensional (2D) Discrete Fourier Transform (DFT) is a basic and computationally intensive algorithm, with a vast variety of applications. 2D images are, in general, non-periodic, but are assumed to be periodic while calculating their DFTs. This leads to cross-shaped artifacts in the frequency domain due to spectral leakage. These artifacts can have critical consequences if the DFTs are being used for further processing. In this paper we present a novel FPGA-based design to calculate high-throughput 2D DFTs with simultaneous edge artifact removal. Standard approaches for removing these artifacts using apodization functions or mirroring, either involve removing critical frequencies or a surge in computation by increasing image size. We use a periodic-plus-smooth decomposition based artifact removal algorithm optimized for FPGA implementation, while still achieving real-time (≥23 frames per second) performance for a 512×512 size image stream. Our optimization approach leads to a significant decrease in external memory utilization thereby avoiding memory conflicts and simplifies the design. We have tested our design on a PXIe based Xilinx Kintex 7 FPGA system communicating with a host PC which gives us the advantage to further expand the design for industrial applications.

[1]  Soonhoi Ha,et al.  Hardware synthesis from coarse-grained dataflow specification for fast HW/SW cosynthesis , 1984, International Conference on Hardware/Software Codesign and System Synthesis, 2004. CODES + ISSS 2004..

[2]  Stanley J. Reeves,et al.  Fast image restoration without boundary artifacts , 2005, IEEE Transactions on Image Processing.

[3]  Anders Hast Robust and Invariant Phase Based Local Feature Matching , 2014, 2014 22nd International Conference on Pattern Recognition.

[4]  Donald G. Bailey,et al.  Design for Embedded Image Processing on FPGAs: Bailey/Design for Embedded Image Processing on FPGAs , 2011 .

[5]  Franz Franchetti,et al.  Generating FPGA-Accelerated DFT Libraries , 2007 .

[6]  Steven G. Johnson,et al.  FFTW: an adaptive software architecture for the FFT , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[7]  Shuvra S. Bhattacharyya,et al.  Resource-efficient acceleration of 2-dimensional Fast Fourier Transform computations on FPGAs , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[8]  Qibin Sun,et al.  A practical print-scan resilient watermarking scheme , 2005, IEEE International Conference on Image Processing 2005.

[9]  L. Kourkoutis,et al.  Periodic Artifact Reduction in Fourier Transforms of Full Field Atomic Resolution Images , 2015, Microscopy and Microanalysis.

[10]  Franz Franchetti,et al.  SPIRAL: Code Generation for DSP Transforms , 2005, Proceedings of the IEEE.

[11]  Abbes Amira,et al.  FPGA implementations of fast fourier transforms for real-time signal and image processing , 2003, Proceedings. 2003 IEEE International Conference on Field-Programmable Technology (FPT) (IEEE Cat. No.03EX798).

[12]  Donald G. Bailey,et al.  Design for Embedded Image Processing on FPGAs , 2011 .

[13]  Lionel Moisan,et al.  Periodic Plus Smooth Image Decomposition , 2011, Journal of Mathematical Imaging and Vision.

[14]  Richard Hansen,et al.  National Instruments LabVIEW: A Programming Environment for Laboratory Automation and Measurement , 2007 .

[15]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[16]  Adrien E. Desjardins,et al.  Real-Time FPGA Processing for High-Speed Optical Frequency Domain Imaging , 2009, IEEE Transactions on Medical Imaging.

[17]  Narayanan Vijaykrishnan,et al.  Accelerating the Nonuniform Fast Fourier Transform Using FPGAs , 2010, 2010 18th IEEE Annual International Symposium on Field-Programmable Custom Computing Machines.

[18]  Daniel X Hammer,et al.  Real-time processing for Fourier domain optical coherence tomography using a field programmable gate array. , 2008, The Review of scientific instruments.

[19]  Narayanan Vijaykrishnan,et al.  Multidimensional DFT IP Generator for FPGA Platforms , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  Mario Bertero,et al.  A simple method for the reduction of boundary effects in the Richardson-Lucy approach to image deconvolution , 2005 .