A Stochastic Approach For The Range Evaluation

Digital Signal Processing (DSP) applications have experienced a very strong development in the last decades, benefiting from the major advances of the semiconductor industry. All practical DSP implementations use fixed-point arithmetic to reduce the area and power consumption and obtain a cost-effective hardware. As a consequence, a conversion from the floating-point description of the algorithm to a fixed-point implementation that adjusts every bit-width in the datapath must be realized. This is an optimization process that consists in finding the minimal fractional part (numerical accuracy evaluation) and integer part (range estimation) wordlengths that still satisfy the performance constraints. In this thesis a stochastic approach for the range evaluation is presented. Our goal is to obtain a complete representation of the variability that incorporates the probabilistic behaviour and not only the maximal and minimal bounds. A method based on the Karhunen-Loeve Expansion is developed at the beginning for the case of linear time-invariant systems. Furthermore, the Polynomial Chaos Expansion is introduced in order to treat non-linear operations. The methods are applied to the optimization of the integer part wordlength when a slight degradation of the performances is acceptable. The range doesn't cover anymore the entire theoretical interval of variation, instead the occurrence of overflows is authorized with a constraint regarding their probability of appearance. Signals that have high variations of their amplitude are approximated with tight intervals so that the implementation cost can be reduced.

[1]  Seehyun Kim,et al.  Fixed-point error analysis and word length optimization of 8×8 IDCT architectures , 1998, IEEE Trans. Circuits Syst. Video Technol..

[2]  A. Kiureghian,et al.  OPTIMAL DISCRETIZATION OF RANDOM FIELDS , 1993 .

[3]  A ConstantinidesGeorge,et al.  Word-length selection for power minimization via nonlinear optimization , 2009 .

[4]  B. Widrow,et al.  Statistical theory of quantization , 1996 .

[5]  George Stefanou,et al.  An enhanced hybrid method for the simulation of highly skewed non-Gaussian stochastic fields , 2005 .

[6]  P. A. Blight The Analysis of Time Series: An Introduction , 1991 .

[7]  Daniel Ménard Méthodologie de compilation d'algorithmes de traitement du signal pour les processeurs en virgule fixe sous contrainte de précision. (Compilation of Signal Processing Algorithm into fixed-point Processor under accuracy constraint) , 2002 .

[8]  Henrik O. Madsen,et al.  Structural Reliability Methods , 1996 .

[9]  O. Sentieys,et al.  Data wordlength optimization for FPGA synthesis , 2005, IEEE Workshop on Signal Processing Systems Design and Implementation, 2005..

[10]  Rob A. Rutenbar,et al.  Floating-point error analysis based on affine arithmetic , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  Romuald Rocher,et al.  Analytical Fixed-Point Accuracy Evaluation in Linear Time-Invariant Systems , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  E. Gumbel,et al.  Statistics of extremes , 1960 .

[13]  Jianwen Zhu,et al.  An analytical approach for dynamic range estimation , 2004, Proceedings. 41st Design Automation Conference, 2004..

[14]  Bill Ravens,et al.  An Introduction to Copulas , 2000, Technometrics.

[15]  Yan Zhang,et al.  Floating-point to Fixed-point Transformation Using Extreme Value Theory , 2009, 2009 Eighth IEEE/ACIS International Conference on Computer and Information Science.

[16]  Habib N. Najm,et al.  Numerical Challenges in the Use of Polynomial Chaos Representations for Stochastic Processes , 2005, SIAM J. Sci. Comput..

[17]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[18]  SungWonyong,et al.  Combined word-length optimization and high-level synthesis of digital signal processing systems , 2006 .

[19]  Jorge Stolfi,et al.  Affine Arithmetic: Concepts and Applications , 2004, Numerical Algorithms.

[20]  Jianwen Zhu,et al.  Dynamic-range estimation , 2006, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[21]  Sajjad Hussain Peak to Average Power ratio Analysis and Reduction of Cognitive Radio signals , 2009 .

[22]  Wonyong Sung,et al.  Simulation-based word-length optimization method for fixed-point digital signal processing systems , 1995, IEEE Trans. Signal Process..

[23]  De Figueiredo,et al.  Self-validated numerical methods and applications , 1997 .

[24]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[25]  Hideki Ochiai,et al.  On the distribution of the peak-to-average power ratio in OFDM signals , 2001, IEEE Trans. Commun..

[26]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[27]  Benoit Van den Nieuwenhof Stochastic finite elements for elastodynamics : random field and shape uncertainty modelling using direct and modal perturbation-based approaches , 2003 .

[28]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[29]  Daniel Ménard,et al.  Automatic evaluation of the accuracy of fixed-point algorithms , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[30]  P. Perona,et al.  Bit-width optimization for configurable DSP's by multi-interval analysis , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[31]  Daniel Ménard,et al.  A case study of the stochastic modeling approach for range estimation , 2010, 2010 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[32]  Daniel Ménard,et al.  Stochastic modeling for floating-point to fixed-point conversion , 2011, 2011 IEEE Workshop on Signal Processing Systems (SiPS).

[33]  S. Blinnikov,et al.  Expansions for nearly Gaussian distributions , 1997 .

[34]  Seehyun Kim,et al.  Fixed-point optimization utility for C and C++ based digital signal processing programs , 1995, VLSI Signal Processing, VIII.

[35]  Robert W. Brodersen,et al.  A perturbation theory on statistical quantization effects in fixed-point DSP with non-stationary inputs , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[36]  Seehyun Kim,et al.  A floating-point to fixed-point assembly program translator for the TMS 320C25 , 1994 .

[37]  David Gregg,et al.  A stochastic bitwidth estimation technique for compact and low-power custom processors , 2008, TECS.

[38]  Octavio Nieto-Taladriz,et al.  Improved Interval-Based Characterization of Fixed-Point LTI Systems With Feedback Loops , 2007, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[39]  Jason Cong,et al.  Evaluation of Static Analysis Techniques for Fixed-Point Precision Optimization , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.

[40]  Robert W. Brodersen,et al.  An automated floating-point to fixed-point conversion methodology , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[41]  Daniel Ménard,et al.  Floating-to-Fixed-Point Conversion for Digital Signal Processors , 2006, EURASIP J. Adv. Signal Process..

[42]  B. Widrow Statistical analysis of amplitude-quantized sampled-data systems , 1961, Transactions of the American Institute of Electrical Engineers, Part II: Applications and Industry.

[43]  W. T. Martin,et al.  The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals , 1947 .

[44]  Octavio Nieto-Taladriz,et al.  Bit-width selection for data-path implementations , 1999, Proceedings 12th International Symposium on System Synthesis.

[45]  Karthick Parashar,et al.  Analytical approach for analyzing quantization noise effects on decision operators , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[46]  Joan Carletta,et al.  Determining appropriate precisions for signals in fixed-point IIR filters , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).

[47]  David Gregg,et al.  Stochastic Bit-Width Approximation Using Extreme Value Theory for Customizable Processors , 2004, CC.

[48]  Laurent-Stéphane Didier,et al.  Range estimation of floating-point variables in Simulink models , 2012, Proceedings of the 2012 Conference on Design and Architectures for Signal and Image Processing.

[49]  Heinrich Meyr,et al.  FRIDGE: a fixed-point design and simulation environment , 1998, Proceedings Design, Automation and Test in Europe.

[50]  Rob A. Rutenbar,et al.  Toward efficient static analysis of finite-precision effects in DSP applications via affine arithmetic modeling , 2003, Proceedings 2003. Design Automation Conference (IEEE Cat. No.03CH37451).

[51]  B. Widrow A Study of Rough Amplitude Quantization by Means of Nyquist Sampling Theory , 1956 .

[52]  Bernard Widrow,et al.  Quantization Noise: Roundoff Error in Digital Computation, Signal Processing, Control, and Communications , 2008 .

[53]  Olivier Sentieys,et al.  A methodology for evaluating the precision of fixed-point systems , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[54]  Bruno Sudret,et al.  A stochastic finite element procedure for moment and reliability analysis , 2006 .

[55]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[56]  M. Rosenblatt Remarks on a Multivariate Transformation , 1952 .

[57]  Rob A. Rutenbar,et al.  Probabilistic interval-valued computation: toward a practical surrogate for statistics inside CAD tools , 2006, 2006 43rd ACM/IEEE Design Automation Conference.

[58]  Anthony C. Davison,et al.  Statistics of Extremes , 2015, International Encyclopedia of Statistical Science.

[59]  Octavio Nieto-Taladriz,et al.  Fast characterization of the noise bounds derived from coefficient and signal quantization , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[60]  N. Cutland,et al.  On homogeneous chaos , 1991, Mathematical Proceedings of the Cambridge Philosophical Society.

[61]  Seehyun Kim,et al.  Fixed-point simulation utility for C and C++ based digital signal processing programs , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[62]  Laurent-Stéphane Didier A statistical method of range estimation for embedded applications , 2008 .

[63]  Wayne Luk,et al.  Ieee Transactions on Computer-aided Design of Integrated Circuits and Systems Accuracy Guaranteed Bit-width Optimization Abstract— We Present Minibit, an Automated Static Approach for Optimizing Bit-widths of Fixed-point Feedforward Designs with Guaranteed Accuracy. Methods to Minimize Both the In- , 2022 .