Multidimensional (MD) Circuits and Systems for Emerging Applications Including Cognitive Radio, Radio Astronomy, Robot Vision and Imaging

Advances in the performance of VLsi circuits are leading to a number of emerging applications of multidimensional (md) filters. Early progress was focused on the numerical design of two dimensional (2-d) transfer functions and the challenging stability issues associated with low-complexity infinite impulse response (iir) implementations. However, over the last decade or so, important practical advances have occurred in the design of 3-d and 4-d iir filters, leading to some important emerging applications. in this tutorial article, some of these applications are described, with emphasis on 2-d spatio-temporal beamforming and 4-d light field processing. in particular, advances in spatio-temporal beamforming for cognitive radio systems and for synthetic aperture radio telescopes are considered. in the 4-d case, we describe a class of 4-d light field filters for image processing, 4-d hyper-fan filters for low-light imaging, depth filtering, denoising and the attenuation of distracting objects, with applications in computational photography and habitat monitoring. Both analog and digital systolic VLsi circuit implementations are described with emphasis on recent progress using field programmable gate array (fPgA)-based and digital VLsi circuits that can potentially operate at radio frequencies in the multi-gHz range. these new innovations open up exciting possibilities for real-time md filters having frames rates in the multi-gHz for emerging radio frequency (rf) antenna signal processing and imaging systems.

[1]  Ieee Acoustics Selected papers in multidimensional digital signal processing , 1986 .

[2]  Leonard T. Bruton,et al.  BIBO stability of inverse 2-D digital filters in the presence of nonessential singularities of the second kind , 1989 .

[3]  V. Tarokh,et al.  Cognitive radio networks , 2008, IEEE Signal Processing Magazine.

[4]  A. Walther Radiometry and coherence , 1968 .

[5]  Leonard T. Bruton A 3D polyphase-DFT cone filter bank for broad band plane wave filtering , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[6]  J. Weatherall,et al.  Nanosecond radio bursts from strong plasma turbulence in the Crab pulsar , 2003, Nature.

[7]  Andreas Antoniou,et al.  Two-Dimensional Digital Filters , 2020 .

[8]  Bruce Veidt,et al.  Development of a Phased-Array feed Demonstrator for radio telescopes , 2005, 11th International Symposium on Antenna Technology and Applied Electromagnetics [ANTEM 2005].

[9]  H.L.P. Madanayake,et al.  Low-complexity distributed parallel processor for 2D IIR broadband beam plane-wave filters , 2007, Canadian Journal of Electrical and Computer Engineering.

[10]  L.T. Bruton,et al.  On the classification of moving objects in image sequences using 3D adaptive recursive tracking filters and neural networks , 1995, Conference Record of The Twenty-Ninth Asilomar Conference on Signals, Systems and Computers.

[11]  Leonard T. Bruton,et al.  Three-dimensional cone filter banks , 2003 .

[12]  T. K. Gunaratne,et al.  Beamforming of Broadband Bandpass Signals using Multidimensional FIR Filters , 2011 .

[13]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[14]  P.D. Patel,et al.  Phased array antennas demonstrator as a radio telescope - EMBRACE , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[15]  L. Bruton,et al.  Design of highly selective two-dimensional recursive fan filters by relaxing symmetry constraints , 1988 .

[16]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[17]  Arjuna Madanayake,et al.  Digital Architectures for UWB Beamforming Using 2D IIR Spatio-Temporal Frequency-Planar Filters , 2012 .

[18]  Leonard T. Bruton,et al.  Two-dimensional discrete filters using spatial integrators , 1983 .

[19]  Sean Victor Hum,et al.  Experimental Characterization of UWB Beamformers Based on Multidimensional Beam Filters , 2011, IEEE Transactions on Antennas and Propagation.

[20]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[21]  Yuejin Zhang,et al.  Differentiator-type three-dimensional recursive ladder filters having frequency-planar- or frequency-beam-shaped passbands , 1992, IEEE Trans. Circuits Syst. Video Technol..

[22]  N. Bose Multidimensional systems theory and applications , 1995 .

[23]  Leonid Belostotski,et al.  A new class of spatially-discrete time-continuous 2D IIR filters based on wave-digital-filter theory , 2011, Proceedings of 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[24]  Edmund Y Lam,et al.  High-resolution lightfield photography using two masks. , 2012, Optics express.

[25]  Najith Liyanage 3D space-time digital filtering for radio astronomy , 2009 .

[26]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[27]  Leonard T. Bruton,et al.  Practical-BIBO stability of n-dimensional discrete systems , 1983 .

[28]  Arjuna Madanayake,et al.  A Systolic-Array Architecture for First-Order 3-D IIR Frequency-Planar Filters , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[29]  Friedrich Jondral,et al.  Cognitive Radio and Dynamic Spectrum Sharing Systems , 2008, EURASIP J. Wirel. Commun. Netw..

[30]  S. Kung,et al.  VLSI Array processors , 1985, IEEE ASSP Magazine.

[31]  Leonard T. Bruton,et al.  Beamforming of Broad-Band Bandpass Plane Waves Using Polyphase 2-D FIR Trapezoidal Filters , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[32]  Leonard T. Bruton,et al.  High-speed systolic ladder structures for multidimensional recursive digital filters , 1996, IEEE Trans. Signal Process..

[33]  Leonard T. Bruton,et al.  A portable high-speed digital image processing instrument for the enhancement of television images , 1986, IEEE Transactions on Instrumentation and Measurement.

[34]  Arjuna Madanayake,et al.  A Systolic Array 2-D IIR Broadband RF Beamformer , 2008, IEEE Transactions on Circuits and Systems II: Express Briefs.

[35]  R.K. Bertschmann,et al.  A 3-D integrator-differentiator double-loop (IDD) filter for raster-scan video processing , 1995, Proceedings of ISCAS'95 - International Symposium on Circuits and Systems.

[36]  Leonard T. Bruton,et al.  A real-time video implementation of a three-dimensional first-order recursive discrete-time filter , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[37]  K. Martin,et al.  Complex signal processing is not-complex , 2003, The 2004 47th Midwest Symposium on Circuits and Systems, 2004. MWSCAS '04..

[38]  Stefan B. Williams,et al.  Monitoring of Benthic Reference Sites: Using an Autonomous Underwater Vehicle , 2012, IEEE Robotics & Automation Magazine.

[39]  Katherine L.C. Bell,et al.  New Frontiers in Ocean Exploration: The E/V Nautilus and NOAA Ship Okeanos Explorer 2011 Field Season , 2012 .

[40]  D. Jones Characterization of a Phased Array Feed Model , 2008 .

[41]  A. Fettweis Wave digital filters: Theory and practice , 1986, Proceedings of the IEEE.

[42]  Zhiping Lin,et al.  Feedback stabilization of multivariable two-dimensional linear systems , 1988 .

[43]  Ren Ng Fourier Slice Photography , 2005 .

[44]  Pan Agathoklis,et al.  On the attenuation of interference and mutual coupling in antenna arrays using 3D space-time filters , 2009, 2009 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[45]  Shengyuan Xu,et al.  A Constructive Approach to Stabilizability and Stabilization of a Class of nD Systems , 2001, Multidimens. Syst. Signal Process..

[46]  Theodore S. Rappaport,et al.  Smart Antennas for Wireless Communications: Is-95 and Third Generation Cdma Applications , 1999 .

[47]  Stefan B. Williams,et al.  Light field image denoising using a linear 4D frequency-hyperfan all-in-focus filter , 2013, Electronic Imaging.

[48]  Thomas S. Huang,et al.  Two-dimensional digital signal processing I. Linear filters. , 1981 .

[49]  M.N.S. Swamy,et al.  On the synthesis of a class of multivariable positive real functions , 1977, Proceedings of the IEEE.

[50]  G. Taubin,et al.  Mask-based light field capture and display , 2011 .

[51]  William D. Jemison,et al.  The Allen Telescope Array: Splitting the Aperture , 2004 .

[52]  David R. DeBoer,et al.  Australian SKA Pathfinder: A High-Dynamic Range Wide-Field of View Survey Telescope , 2009, Proceedings of the IEEE.

[53]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[54]  Arjuna Madanayake,et al.  Synthesis and Array Processor Realization of a 2-D IIR Beam Filter for Wireless Applications , 2012, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[55]  Christophe Granet,et al.  Focal Plane Array Development for ASKAP (Australian SKA Pathfinder) , 2007 .

[56]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[57]  L.T. Bruton,et al.  UWB Beamforming Using 2-D Beam Digital Filters , 2009, IEEE Transactions on Antennas and Propagation.

[58]  Leonard T. Bruton,et al.  A 4-D Dual-Fan Filter Bank for Depth Filtering in Light Fields , 2007, IEEE Transactions on Signal Processing.

[59]  K. Galkowski,et al.  LMI approach to state-feedback stabilization of multidimensional systems , 2003 .

[60]  Dieter Fox,et al.  Sparse distance learning for object recognition combining RGB and depth information , 2011, 2011 IEEE International Conference on Robotics and Automation.

[61]  Leonard T. Bruton,et al.  Three-dimensional image processing using the concept of network resonance , 1985 .

[62]  M.N.S. Swamy,et al.  A class of multivariable positive real functions realizable by resistively terminated lossless ladder networks , 1979 .

[63]  L. Bruton,et al.  Design of 3-D planar and beam recursive digital filters using spectral transformation , 1989 .

[64]  Arnold van Ardenne,et al.  Extending the Field of View With Phased Array Techniques: Results of European SKA Research , 2009, Proceedings of the IEEE.

[65]  Arjuna Madanayake,et al.  Broadband Multiple Cone-Beam 3-D IIR Digital Filters Applied to Planar Dense Aperture Arrays , 2012, IEEE Transactions on Antennas and Propagation.

[67]  Thushara K. Gunaratne,et al.  Adaptive Complex-Coefficient 2D FIR Trapezoidal Filters for Broadband Beamforming in Cognitive Radio Systems , 2011, Circuits Syst. Signal Process..

[68]  Arjuna Madanayake,et al.  A systolic-array architecture for first-order 4-D IIR frequency-planar digital filters , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[69]  Stefan B. Williams,et al.  Seabed modeling and distractor extraction for mobile AUVs using light field filtering , 2011, 2011 IEEE International Conference on Robotics and Automation.

[70]  Leonard T. Bruton,et al.  A novel low-complexity spatio-temporal ultra wide-angle polyphase cone filter bank applied to sub-pixel motion discrimination , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[71]  P. Agathoklis,et al.  Broadband Beamforming of Focal Plane Array (FPA) Signals Using Real-Time Spatio-Temporal 3D FIR Frustum Digital Filters , 2011, IEEE Transactions on Antennas and Propagation.

[72]  N. Bose Feature - Multidimensional systems and signal processing: Good theory for good practice , 2007, IEEE Circuits and Systems Magazine.

[73]  Leonard T. Bruton,et al.  Highly selective three-dimensional recursive beam filters using intersecting resonant planes , 1983 .

[74]  Leonard T. Bruton,et al.  Reducing the computational complexity of narrowband 2D fan filters using shaped 2D window functions , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[75]  M. A. Sid-Ahmed Two-dimensional analog filters: a new form of realization , 1989 .

[76]  Arjuna Madanayake,et al.  Continuous-Time Analog Two-Dimensional IIR Beam Filters , 2012, IEEE Transactions on Circuits and Systems II: Express Briefs.

[77]  Leonard T. Bruton,et al.  On the practical BIBO stability of multidimensional filters , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[78]  Leonard T. Bruton,et al.  The design of highly selective adaptive three-dimensional recursive cone filters , 1987 .

[79]  Arjuna Madanayake,et al.  A Fully Multiplexed First-Order Frequency-Planar Module for Fan, Beam, and Cone Plane-Wave Filters , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[80]  Reinhard Koch,et al.  Pose estimation and map building with a Time-Of-Flight-camera for robot navigation , 2008, Int. J. Intell. Syst. Technol. Appl..

[81]  James M. Keller,et al.  Dynamic image sequence analysis using fuzzy measures , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[82]  Yang Song,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[83]  M. A. Sid-Ahmed,et al.  2-D analog filters for real time video signal processing , 1990 .

[84]  Alfred Fe MULTIDIMENSIONAL WAVE-DIGITAL PRINCIPLES: FROM FILTERING TO NUMERICAL INTEGRATION , 1994 .

[85]  Leonard T. Bruton,et al.  PARALLEL COMPUTING IN MULTIDIMENSIONAL RECURSIVE FILTERING , 1993 .

[86]  Basant Kumar Mohanty,et al.  High throughput and low-latency implementation of bit-level systolic architecture for 1D and 2D digital filters , 1999 .

[87]  Huseyin Arslan,et al.  Cognitive Radio, Software Defined Radio, and Adaptive Wireless Systems (Signals and Communication Technology) , 2007 .

[88]  R. Schilizzi The Square Kilometre Array , 2006, Proceedings of the International Astronomical Union.

[89]  Arjuna Madanayake,et al.  Design and FPGA-implementation of 1st-order 4D IIR frequency-hyperplanar digital filters , 2011, 2011 IEEE 54th International Midwest Symposium on Circuits and Systems (MWSCAS).

[90]  Yang Song,et al.  Tour the world: a technical demonstration of a web-scale landmark recognition engine , 2009, ACM Multimedia.

[91]  Leonard T. Bruton,et al.  Design of stable two‐dimensional analogue and digital filters with applications in image processing , 1979 .

[92]  Leonard T. Bruton,et al.  Applications of lossless MD structures for the filtering of digital image sequences , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[93]  Holger Blume,et al.  One-and-Multidimensional Signal Processing: Algorithms and Applications in Image Processing , 2000 .

[94]  Leonard T. Bruton,et al.  A 4D frequency-planar IIR filter and its application to light field processing , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[95]  Arjuna Madanayake,et al.  Reducing the Multiplier-Complexity of Massively Parallel Polyphase 2D IIR Broadband Beam Filters , 2012, Circuits Syst. Signal Process..

[96]  Arjuna Madanayake,et al.  Massively parallel systolic‐array architectures for 2d IIR polyphase space–time plane‐wave beam digital filters , 2012, Int. J. Circuit Theory Appl..

[97]  Frédo Durand,et al.  4D frequency analysis of computational cameras for depth of field extension , 2009, SIGGRAPH '09.

[98]  Leonard T. Bruton,et al.  The enhancement and tracking of moving objects in digital images using adaptive three-dimensional recursive filters , 1986 .

[99]  Design of stable 2-dimensional discrete recursive filters , 1976 .

[100]  Arjuna Madanayake,et al.  2D space–time wave-digital multi-fan filter banks for signals consisting of multiple plane waves , 2014, Multidimens. Syst. Signal Process..

[101]  Yuejin Zhang,et al.  Applications of 3-D LCR networks in the design of 3-D recursive filters for processing image sequences , 1994, IEEE Trans. Circuits Syst. Video Technol..

[102]  Leonard T. Bruton,et al.  Applications of 3D LCR networks in the design of 3D recursive filters , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[103]  Leonard T. Bruton,et al.  Sensitivity Analysis Of 3-D Recursive Digital Beam Filter Structures , 1988, Twenty-Second Asilomar Conference on Signals, Systems and Computers.

[104]  Leonard T. Bruton,et al.  3-D IIR filtering using decimated DFT-polyphase filter bank structures , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[105]  Mark A. Horowitz,et al.  Light field video camera , 2000, IS&T/SPIE Electronic Imaging.

[106]  J. Lazio,et al.  The square kilometer array (SKA) radio telescope: Progress and technical directions , 2008 .

[107]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[108]  Leonard T. Bruton,et al.  Design and implementation of 3-D recursive digital filters by applying spectral transformations to LC filter networks , 1988, 1988., IEEE International Symposium on Circuits and Systems.