The Power of Orthogonal Filtering

Orthogonal filtering is a method to extract essential information from digital data using orthogonal transformations. It belongs to the category of Wave Digital Filters (WDF?s) as originally defined and considered by the late Alfred Fettweis, one of the principal founders of modern digital filter theory. In the original WDF theory, filtering is done using adders and an algebraically minimal number of multipliers exclusively. When, instead, the arithmetic is based (also exclusively) on purely orthogonal transformations (Jacobi/Givens rotations), a much larger category of lossless digital filters is obtained. In this paper, it is shown how central classical problems with many engineering applications, namely quadratically optimal tracking (Bellman), linear least squares estimation (Kalman) and spectral factorization (Wiener), among many other types of filters, produce natural orthogonal filters and can be obtained and designed using nothing more than orthogonal transformations. Simple proofs based on these insights are provided, together with a streamlined realization theory for the resulting data processors and filters. The paper uses nothing more than elementary matrix theory, and should be accessible to students with no other background, although it does at some point make the connection with the Beurling-Lax theory on inner-outer factorization and the Wiener theory on spectral factorization, putting these theories in a purely matrix algebra context.

[1]  and Charles K. Taft Reswick,et al.  Introduction to Dynamic Systems , 1967 .

[2]  M. Morf,et al.  Square-root algorithms for least-squares estimation , 1975 .

[3]  Thomas Kailath Lectures on linear least-squares estimation , 1976 .

[4]  Patrick Dewilde,et al.  Object‐oriented data management based on abstract data types , 1987, Softw. Pract. Exp..

[5]  R Bellman,et al.  On the Theory of Dynamic Programming. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[7]  G. Cybenko A general orthogonalization technique with applications to time series analysis and signal processing , 1983 .

[8]  K. Jainandunsing,et al.  A new class of parallel algorithms for solving systems of linear equations , 1989 .

[9]  H. Helson,et al.  Lectures on invariant subspaces , 2013 .

[10]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[11]  Patrick Dewilde On the LU factorization of infinite systems of semi-separable equations , 2012 .

[12]  Brian D. O. Anderson,et al.  Linear Optimal Control , 1971 .

[13]  A. Beurling On two problems concerning linear transformations in hilbert space , 1949 .

[14]  Translation invariant subspaces of $L^{p}(G)$ , 1973 .

[15]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[16]  W. Rudin Real and complex analysis , 1968 .

[17]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[18]  Shivkumar Chandrasekaran,et al.  A Fast Solver for HSS Representations via Sparse Matrices , 2006, SIAM J. Matrix Anal. Appl..

[19]  V. Belevitch,et al.  Classical network theory , 1968 .

[20]  Michael A. Arbib,et al.  Topics in Mathematical System Theory , 1969 .