On Optimal Perfect Reconstruction Feedback Quantizers

This paper presents novel results on perfect reconstruction feedback quantizers (PRFQs), i.e., noise-shaping, predictive and sigma-delta A/D converters whose signal transfer function is unity. Our analysis of this class of converters is based upon an additive white noise model of quantization errors. Our key result is a formula that relates the minimum achievable MSE of such converters to the signal-to-noise ratio (SNR) of the scalar quantizer embedded in the feedback loop. This result allows us to obtain analytical expressions that characterize the corresponding optimal filters. We also show that, for a fixed SNR of the scalar quantizer, the end-to-end MSE of an optimal PRFQ which uses the optimal filters (which for this case turn out to be IIR) decreases exponentially with increasing oversampling ratio. Key departures from earlier work include the fact that fed back quantization noise is explicitly taken into account and that the order of the converter filters is not a priori restricted.

[1]  G. Goodwin,et al.  Optimal noise shaping for Networked Control Systems , 2007, 2007 European Control Conference (ECC).

[2]  R. L. Frost,et al.  Error spectrum shaping quantizers with non-ideal reconstruction filters and saturating quantizers , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[3]  Bishnu S. Atal,et al.  Predictive coding of speech signals and subjective error criteria , 1978, ICASSP.

[4]  Helmut Bölcskei,et al.  Noise reduction in oversampled filter banks using predictive quantization , 2001, IEEE Trans. Inf. Theory.

[5]  W. R. Bennett,et al.  Reduction of Quantizing Noise by Use of Feedback , 1966 .

[6]  R. Jackson.  Inequalities , 2007, Algebra for Parents.

[7]  G. Temes.  Delta-sigma data converters , 1994 .

[8]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[9]  R. Weinstock.  Calculus of Variations: with Applications to Physics and Engineering , 1952 .

[10]  P. Vaidyanathan,et al.  Statistically optimum pre- and postfiltering in quantization , 1997 .

[11]  P. Noll.  On predictive quantizing schemes , 1978, The Bell System Technical Journal.

[12]  Robert A. Wannamaker.  Psychoacoustically Optimal Noise Shaping , 1992 .

[13]  I. Daubechies,et al.  Approximating a bandlimited function using very coarsely quantized data: A family of stable sigma-delta modulators of arbitrary order , 2003 .

[14]  K. H. Barratt.  Digital Coding of Waveforms , 1985 .

[15]  S. Tewksbury,et al.  Oversampled, linear predictive and noise-shaping coders of order N g 1 , 1978 .

[16]  Michael A. Gerzon,et al.  Optimal Noise Shaping and Dither of Digital Signals , 1989 .

[17]  John Vanderkooy,et al.  A Theory of Non-Subtractive Dither , 2003 .

[18]  R. Schreier,et al.  Delta-sigma data converters : theory, design, and simulation , 1997 .

[19]  R. C. Brainard,et al.  Direct-feedback coders: Design and performance with television signals , 1969 .

[20]  David L. Neuhoff,et al.  Asymptotic analysis of optimal fixed-rate uniform scalar quantization , 2001, IEEE Trans. Inf. Theory.

[21]  Graham C. Goodwin,et al.  Multistep optimal analog-to-digital conversion , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[22]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[23]  Allen Gersho,et al.  Principles of quantization , 1978 .

[24]  Michael T. Orchard,et al.  On the DPCM compression of Gaussian autoregressive sequences , 2001, IEEE Trans. Inf. Theory.

[25]  C. S. Güntürk.  One‐bit sigma‐delta quantization with exponential accuracy , 2003 .

[26]  J. Miller.  Numerical Analysis , 1966, Nature.

[27]  W. R. Bennett,et al.  Spectra of quantized signals , 1948, Bell Syst. Tech. J..

[28]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[29]  J.-H. Lee,et al.  Digital color halftoning , 2005, IEEE Signal Processing Magazine.

[30]  Gabor C. Temes,et al.  Understanding Delta-Sigma Data Converters , 2004 .

[31]  Graham C. Goodwin,et al.  Fundamental Limitations in Filtering and Control , 1997 .

[32]  Patrick Stewart Osmer.  The Cerro Tololo Inter-American Observatory. , 2000 .

[33]  S. Brendle,et al.  Calculus of Variations , 1927, Nature.

[34]  John B. O'Neal.  Bounds on subjective performance measures for source encoding systems , 1971, IEEE Trans. Inf. Theory.

[35]  Graham C. Goodwin,et al.  The Quadratic Gaussian Rate-Distortion Function for Source Uncorrelated Distortions , 2008, Data Compression Conference (dcc 2008).

[36]  Carl E. Pearson,et al.  Functions of a complex variable - theory and technique , 2005 .

[37]  John Vanderkooy,et al.  Minimally Audible Noise Shaping , 1991 .

[38]  John Vanderkooy,et al.  A theory of nonsubtractive dither , 2000, IEEE Trans. Signal Process..

[39]  Kwang-Woon Lee,et al.  Suppression of harmonic spikes in switching converter output using dithered sigma-delta modulation , 2001, Conference Record of the 2001 IEEE Industry Applications Conference. 36th IAS Annual Meeting (Cat. No.01CH37248).