Automating transformations from floating-point to fixed-point for implementing digital signal processing algorithms

Many digital signal processing and communication algorithms are first simulated using floating-point arithmetic and later transformed into fixed-point arithmetic to reduce implementation complexity. This transformation process may take more than 50% of the design time for complex designs. In addition, wordlengths in fixed-point designs may be altered at later stages in the design cycle. Different choices of wordlengths lead to different tradeoffs between signal quality and implementation complexity. In this dissertation, I propose two methods for characterizing the tradeoffs between signal quality and implementation complexity during the transformation of digital system designs to fixed-point arithmetic and variables. The first method, a gradient-based search for single-objective optimization with sensitivity information, scales linearly with the number of variables, but can become trapped in local optima. Based on wordlength design case studies for a wireless communication demodulator, adding sensitivity information reduces the search time by a factor of four and yields a design with 30% lower implementation costs. The second method, a genetic algorithm for multi-objective optimization, provides a Pareto optimal front that evolves towards the optimal tradeoff curve for signal quality vs. implementation complexity. This second method can be used to fully characterize the design space. I propose to use wordlength reduction methods of signed right shift and truncation to reduce power consumption in a given hardware architecture. For each method, I derive the expected values of the number of gates that switch during multiplication of the inputs. I apply the signed right shift method and the truncation method to a 16-bit radix-4 modified Booth multiplier and a 16-bit Wallace multiplier. The truncation method with 8-bit operands reduces the power consumption by 56% in the Wallace multiplier and 31% in the Booth multiplier. The signed right shift method shows a 25% power reduction in the Booth multiplier, but no power reduction in the Wallace multiplier. Finally, this dissertation describes a method to automate design assistance for transformation from floating-point to fixed-point data types. Floating-point programs are converted to fixed-point programs by a code generator. Then, the proposed wordlength search algorithms offer designers the freedom to determine data wordlengths to optimize the tradeoffs between signal quality and implementation complexity.

[1]  Miki Haseyama,et al.  A filter coefficient quantization method with genetic algorithm, including simulated annealing , 2006, IEEE Signal Processing Letters.

[2]  Hanho Lee A power-aware scalable pipelined Booth multiplier , 2004, IEEE International SOC Conference, 2004. Proceedings..

[3]  Tughrul Arslan,et al.  A genetic algorithm for the optimisation of a reconfigurable pipelined FFT processor , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[4]  Prithviraj Banerjee,et al.  Automatic conversion of floating point MATLAB programs into fixed point FPGA based hardware design , 2003, 11th Annual IEEE Symposium on Field-Programmable Custom Computing Machines, 2003. FCCM 2003..

[5]  T. M. Williams Practical Methods of Optimization. Vol. 2 — Constrained Optimization , 1982 .

[6]  J. A. Wepman,et al.  Analog-to-digital converters and their applications in radio receivers , 1995, IEEE Commun. Mag..

[7]  K. F. Man,et al.  FUZZY CONTROL OF WATER PRESSURE USING GENETIC ALGORITHM , 1995 .

[8]  Reconfigurable low energy multiplier for multimedia system design , 2000, Proceedings IEEE Computer Society Workshop on VLSI 2000. System Design for a System-on-Chip Era.

[9]  Sam Kwong,et al.  Genetic algorithms and their applications , 1996, IEEE Signal Process. Mag..

[10]  Seehyun Kim,et al.  A floating-point to fixed-point assembly program translator for the TMS 320C25 , 1994 .

[11]  David E. Goldberg,et al.  Genetic and evolutionary algorithms come of age , 1994, CACM.

[12]  G. Jullien,et al.  Digital filter design using genetic algorithm , 1998, 1998 IEEE Symposium on Advances in Digital Filtering and Signal Processing. Symposium Proceedings (Cat. No.98EX185).

[13]  Hartmut Pohlheim,et al.  Genetic and evolutionary algorithm toolbox for use with matlab , 1994 .

[14]  M. J. Hicks,et al.  Recursive adaptive filter design using an adaptive genetic algorithm , 1982, ICASSP.

[15]  William Cammack,et al.  Fixpt: a C++ method for development of fixed point digital signal processing algorithms , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[16]  François Charot,et al.  Automatic floating-point to fixed-point conversion for DSP code generation , 2002, CASES '02.

[17]  Mark Stephenson,et al.  Bidwidth analysis with application to silicon compilation , 2000, PLDI '00.

[18]  Yvon Savaria,et al.  An automatic word length determination method , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[19]  Wonyong Sung,et al.  AUTOSCALER for C: an optimizing floating-point to integer C program converter for fixed-point digital signal processors , 2000 .

[20]  Wayne Luk,et al.  Optimum wordlength allocation , 2002, Proceedings. 10th Annual IEEE Symposium on Field-Programmable Custom Computing Machines.

[21]  Yvon Savaria,et al.  A comparison of automatic word length optimization procedures , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[22]  Christopher S. Wallace,et al.  A Suggestion for a Fast Multiplier , 1964, IEEE Trans. Electron. Comput..

[23]  Sharad Malik,et al.  Power analysis of embedded software: a first step towards software power minimization , 1994, IEEE Trans. Very Large Scale Integr. Syst..

[24]  Daniel S. Baum Simulating the SUI Channel Models , 2001 .

[25]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[26]  Yun Cao,et al.  Variable size analysis and validation of computation quality , 2000, Proceedings IEEE International High-Level Design Validation and Test Workshop (Cat. No.PR00786).

[27]  Seongsoo Hong,et al.  Proceedings of the 2006 international conference on Compilers, architecture and synthesis for embedded systems , 2002 .

[28]  Sharad Malik,et al.  Power analysis and minimization techniques for embedded DSP software , 1997, IEEE Trans. Very Large Scale Integr. Syst..

[29]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[30]  Rob A. Rutenbar,et al.  Floating-point bit-width optimization for low-power signal processing applications , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[31]  Tughrul Arslan,et al.  A multi-objective genetic algorithm for on-chip real-time optimisation of word length and power consumption in a pipelined FFT processor targeting a MC-CDMA receiver , 2005, 2005 NASA/DoD Conference on Evolvable Hardware (EH'05).

[32]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[33]  Miodrag Potkonjak,et al.  Optimizing power using transformations , 1995, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[34]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[35]  Mark A. Clements,et al.  Multiple objective evolutionary algorithms for independent, computationally expensive objective evaluations , 2004 .

[36]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[37]  Hojjat Adeli,et al.  A parallel genetic/neural network learning algorithm for MIMD shared memory machines , 1994, IEEE Trans. Neural Networks.

[38]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[39]  Wayne Luk,et al.  Wordlength optimization for linear digital signal processing , 2003, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[40]  A. Constantinides,et al.  Finite word length FIR filter design using integer programming over a discrete coefficient space , 1982 .

[41]  Hanjin Cho,et al.  Numerical word-length optimization for CDMA demodulator , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[42]  Behrouz Nowrouzian,et al.  A novel technique for optimization over the canonical signed-digit number space using genetic algorithms , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[43]  Yong Ching Lim,et al.  Genetic algorithm approach for the optimization of multiplierless sub-filters generated by the frequency-response masking technique , 2002, 9th International Conference on Electronics, Circuits and Systems.

[44]  B.L. Evans,et al.  Data wordlength reduction for low-power signal processing software , 2004, IEEE Workshop onSignal Processing Systems, 2004. SIPS 2004..

[45]  B. Nowrouzian,et al.  Crossover and mutation in genetic algorithms employing canonical signed-digit number system , 1997, Proceedings of 40th Midwest Symposium on Circuits and Systems. Dedicated to the Memory of Professor Mac Van Valkenburg.

[46]  SungWonyong,et al.  Combined word-length optimization and high-level synthesis of digital signal processing systems , 2006 .

[47]  Alok N. Choudhary,et al.  Precision and error analysis of MATLAB applications during automated hardware synthesis for FPGAs , 2001, Proceedings Design, Automation and Test in Europe. Conference and Exhibition 2001.

[48]  Kim-Fung Man,et al.  Design and optimization of IIR filter structure using hierarchical genetic algorithms , 1998, IEEE Trans. Ind. Electron..

[49]  Alex K. Jones,et al.  A MATLAB compiler for distributed, heterogeneous, reconfigurable computing systems , 2000, Proceedings 2000 IEEE Symposium on Field-Programmable Custom Computing Machines (Cat. No.PR00871).

[50]  Robert W. Brodersen,et al.  Automated fixed-point data-type optimization tool for signal processing and communication systems , 2004, Proceedings. 41st Design Automation Conference, 2004..

[51]  D. Kodek Design of optimal finite wordlength FIR digital filters using integer programming techniques , 1980 .

[52]  Hsi-Pin Ma,et al.  A 2.6-V, 44-MHz all-digital QPSK direct-sequence spread-spectrum transceiver IC [wireless LANs] , 1997 .

[53]  Kenneth H. Rosen Handbook of Discrete and Combinatorial Mathematics , 1999 .

[54]  K. Stratos,et al.  Constrained Optimization , 2018, Design Optimization using MATLAB and SOLIDWORKS.

[55]  Brian L. Evans,et al.  Wordlength optimization with complexity-and-distortion measure and its application to broadband wireless demodulator design , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[56]  Carlos A. Coello Coello,et al.  Guest editorial: special issue on evolutionary multiobjective optimization , 2003, IEEE Trans. Evol. Comput..

[57]  Nam Ik Cho,et al.  Optimal design of finite precision FIR filters using linear programming with reduced constraints , 1998, IEEE Trans. Signal Process..

[58]  D. Xu,et al.  Design of optimal digital filter using a parallel genetic algorithm , 1995 .

[59]  Griff L. Bilbro,et al.  Comparison of a genetic algorithm with a simulated annealing algorithm for the design of an ATM network , 2000, IEEE Communications Letters.

[60]  Keshab K. Parhi,et al.  VLSI digital signal processing systems , 1999 .

[61]  Earl E. Swartzlander,et al.  Analysis of column compression multipliers , 2001, Proceedings 15th IEEE Symposium on Computer Arithmetic. ARITH-15 2001.

[62]  R. Cmar,et al.  A methodology and design environment for DSP ASIC fixed point refinement , 1999, Design, Automation and Test in Europe Conference and Exhibition, 1999. Proceedings (Cat. No. PR00078).

[63]  Tughrul Arslan,et al.  Low power multiplication scheme for FIR filter implementation on single multiplier CMOS DSP processors , 1996 .

[64]  Anantha P. Chandrakasan,et al.  Minimizing power consumption in digital CMOS circuits , 1995, Proc. IEEE.

[65]  D. Winfield,et al.  Optimization: Theory and practice , 1972 .

[66]  Jurij F. Tasic,et al.  Word-length optimization of LMS adaptive FIR filters , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[67]  Rob A. Rutenbar,et al.  Reducing power by optimizing the necessary precision/range of floating-point arithmetic , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[68]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[69]  Arabinda Tripathy Numerical Optimization of Computer Models , 1982 .

[70]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[71]  Wonyong Sung,et al.  Simulation-based word-length optimization method for fixed-point digital signal processing systems , 1995, IEEE Trans. Signal Process..

[72]  Oscal T.-C. Chen,et al.  Minimization of switching activities of partial products for designing low-power multipliers , 2003, IEEE Trans. Very Large Scale Integr. Syst..

[73]  Ali Esmaili,et al.  Probability and Random Processes , 2005, Technometrics.

[74]  Seehyun Kim,et al.  Fixed-point optimization utility for C and C++ based digital signal processing programs , 1998 .

[75]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[76]  E. Moreno,et al.  Application of genetic algorithms and simulated annealing technique in optimising the aperture distributions of antenna array patterns , 1996 .

[77]  Vinko Erceg,et al.  Channel Models for Fixed Wireless Applications , 2001 .

[78]  Sam Kwong,et al.  Genetic structure for NN topology and weights optimization , 1995 .

[79]  Wonyong Sung,et al.  A CORDIC-based digital quadrature mixer: comparison with a ROM-based architecture , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[80]  Heinrich Meyr,et al.  Integer code generation for the TI TMS320C62X , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[81]  Charles L. Karr,et al.  Genetic algorithms for fuzzy controllers , 1991 .

[82]  D. Suckley Genetic algorithm in the design of FIR filters , 1991 .

[83]  B. Nowrouzian,et al.  Optimization of FIR digital filters over the canonical signed-digit coefficient space using genetic algorithms , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[84]  P. M. Chau,et al.  A model for estimating power dissipation in a class of DSP VLSI chips , 1991 .

[85]  Naresh R. Shanbhag,et al.  Complexity analysis of multicarrier and single-carrier systems for very high-speed digital subscriber line , 2003, IEEE Trans. Signal Process..

[86]  Arogyaswami Paulraj,et al.  Fixed broadband wireless access: state of the art, challenges, and future directions , 2001 .

[87]  Heinrich Meyr,et al.  FRIDGE: a fixed-point design and simulation environment , 1998, Proceedings Design, Automation and Test in Europe.

[88]  A. Gray,et al.  I. THE ORIGIN OF SPECIES BY MEANS OF NATURAL SELECTION , 1963 .

[89]  Franz Franchetti,et al.  SPIRAL: Code Generation for DSP Transforms , 2005, Proceedings of the IEEE.

[90]  G. Wade,et al.  Multiplier-less FIR filter design using a genetic algorithm , 1994 .

[91]  Andrew D. Booth,et al.  A SIGNED BINARY MULTIPLICATION TECHNIQUE , 1951 .

[92]  D. Fogel System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling , 1991 .

[93]  Behrooz Parhami,et al.  Computer arithmetic - algorithms and hardware designs , 1999 .

[94]  D. Ait-Boudaoud,et al.  Genetic approach to design of multiplierless FIR filters , 1993 .

[95]  Patrick Schaumont,et al.  A methodology and design environment for DSP ASIC fixed point refinement , 1999, DATE '99.

[96]  Li Lee,et al.  Closed-form and real-time wordlength adaptation , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[97]  W. P. Burleson,et al.  Search-based wordlength optimization for VLSI/DSP synthesis , 1994, Proceedings of 1994 IEEE Workshop on VLSI Signal Processing.

[98]  Kyungtae Han,et al.  Bit Constraint Parameter Decision Method for CDMA Digital Demodulator , 2000 .