Improved precision of fixed-point algorithms by means of common factors

We describe a general technique for improving the precision of fixed-point implementations of signal processing algorithms (such as filters, transforms, etc.) relying on the use of "common factors". Such factors are applied to groups of real constants in the algorithms (e.g. filter coefficients), turning them into quantities that can be more accurately approximated by dyadic rational numbers. We show that the problem of optimal design of such approximations is related to the classic Diophantine approximation problem, and explain how it can be solved and used for improving practical designs.

[1]  J. Cassels,et al.  An Introduction to Diophantine Approximation , 1957 .

[2]  Martin Vetterli,et al.  A Discrete Fourier-Cosine Transform Chip , 1986, IEEE J. Sel. Areas Commun..

[3]  L. Lovász,et al.  Geometric Algorithms and Combinatorial Optimization , 1981 .

[4]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..