Sampling from a system-theoretic viewpoint

This paper studies a system-theoretic approach to the problem of reconstructing an analog signal from its samples. The idea, borrowed from earlier treatments in the control literature, is to address the problem as a hybrid model-matching problem in which performance is measured by system norms. The paper is split into three parts. In Part I we present the paradigm and revise the lifting technique, which is our main technical tool. In Part II optimal samplers and holds are designed for various analog signal reconstruction problems. In some cases one component is fixed while the remaining are designed, in other cases all three components are designed simultaneously. No causality requirements are imposed in Part II, which allows to use frequency domain arguments, in particular the lifted frequency response as introduced in Part I. In Part III the main emphasis is placed on a systematic incorporation of causality constraints into the optimal design of reconstructors. We consider reconstruction problems, in which the sampling (acquisition) device is given and the performance is measured by the $L^2$-norm of the reconstruction error. The problem is solved under the constraint that the optimal reconstructor is $l$-causal for a given $l\geq 0,$ i.e., that its impulse response is zero in the time interval $(-\infty,-l h),$ where $h$ is the sampling period. We derive a closed-form state-space solution of the problem, which is based on the spectral factorization of a rational transfer function.

[1]  Gjerrit Meinsma,et al.  Noncausal sampled signal reconstruction from noisy measurements: A system-theoretic approach , 2007, 2007 46th IEEE Conference on Decision and Control.

[2]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART I-THEORY , 1993 .

[3]  Sheldon S. L. Chang,et al.  Synthesis of Optimum Control Systems , 1961 .

[4]  L. Mirkin,et al.  System theoretic perspectives of the sampling theorem , 2006 .

[5]  Michael Unser,et al.  On the optimality of ideal filters for pyramid and wavelet signal approximation , 1993, IEEE Trans. Signal Process..

[6]  Bruce A. Francis,et al.  Optimal Sampled-Data Control Systems , 1996, Communications and Control Engineering Series.

[7]  John Bowman Thomas,et al.  An introduction to statistical communication theory , 1969 .

[8]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[9]  R. Cooke Real and Complex Analysis , 2011 .

[10]  H. Robbins An Extension of Wiener Filter Theory to Partly Sampled Systems , 1959 .

[11]  Leonid Mirkin,et al.  Imposing FIR Structure on H2 Preview Tracking and Smoothing Solutions , 2006, CDC.

[12]  Akram Aldroubi,et al.  Nonuniform Sampling and Reconstruction in Shift-Invariant Spaces , 2001, SIAM Rev..

[13]  Gjerrit Meinsma,et al.  Truncated norms and limitations on signal reconstruction , 2010 .

[14]  J. Yen On Nonuniform Sampling of Bandwidth-Limited Signals , 1956 .

[15]  Bassam Bamieh,et al.  The 2 problem for sampled-data systems , 1992, Systems & Control Letters.

[16]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[17]  Gene H. Golub,et al.  Matrix computations , 1983 .

[18]  Yakar Kannai,et al.  Approximating signals by fast impulse sampling , 1993, Math. Control. Signals Syst..

[19]  A. J. Jerri The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[20]  Leonid Mirkin,et al.  Yet another H/sup /spl infin// discretization , 2003 .

[21]  T. Kailath,et al.  Indefinite-quadratic estimation and control: a unified approach to H 2 and H ∞ theories , 1999 .

[22]  A. Papoulis,et al.  Generalized sampling expansion , 1977 .

[23]  R. E. Kalman,et al.  Controllability of linear dynamical systems , 1963 .

[24]  S. Parrott,et al.  On a quotient norm and the Sz.-Nagy-Foiaş lifting theorem , 1978 .

[25]  P. Khargonekar Control System Synthesis: A Factorization Approach (M. Vidyasagar) , 1987 .

[26]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART II-EFFICIENT DESIGN AND APPLICATIONS , 1993 .

[27]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[28]  Leonid Mirkin,et al.  Yet another H∞ discretization , 2003, IEEE Trans. Autom. Control..

[29]  Geir E. Dullerud Control of Uncertain Sampled-Data Systems , 1995 .

[30]  LEONID MIRKIN,et al.  Imposing FIR Structure on H2 Preview Tracking and Smoothing Solutions , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[31]  Bassam Bamieh,et al.  A general framework for linear periodic systems with applications to H/sup infinity / sampled-data control , 1992 .

[32]  Leonid Mirkin,et al.  On Geometric and Analytic Constraints in the ${H}^{{\infty} }$ Fixed-Lag Smoothing , 2007, IEEE Transactions on Automatic Control.

[33]  Michael Unser,et al.  B-spline signal processing. I. Theory , 1993, IEEE Trans. Signal Process..

[34]  Gjerrit Meinsma,et al.  On a key sampling formula relating the Laplace and L transforms , 1997 .

[35]  J. R. Ragazzini,et al.  Sampled-Data Control Systems , 1959 .

[36]  Tongwen Chen,et al.  Design of multirate filter banks by 𝒽∞ optimization , 1995, IEEE Trans. Signal Process..

[37]  Pramod P. Khargonekar,et al.  Frequency response of sampled-data systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[38]  Babak Hassibi,et al.  Indefinite-Quadratic Estimation And Control , 1987 .

[39]  J. R. Higgins Sampling theory in Fourier and signal analysis : foundations , 1996 .

[40]  C. Scherer Mixed H2/H∞ Control , 1995 .

[41]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[42]  Leiba Rodman,et al.  Algebraic Riccati equations , 1995 .

[43]  P. Vaidyanathan Generalizations of the sampling theorem: Seven decades after Nyquist , 2001 .

[44]  Ali H. Sayed,et al.  A survey of spectral factorization methods , 2001, Numer. Linear Algebra Appl..

[45]  Yonina C. Eldar,et al.  Nonideal sampling and interpolation from noisy observations in shift-invariant spaces , 2006, IEEE Transactions on Signal Processing.

[46]  Davor Petrinovic,et al.  Causal Cubic Splines: Formulations, Interpolation Properties and Implementations , 2008, IEEE Transactions on Signal Processing.

[47]  Gjerrit Meinsma,et al.  Sampled Signal Reconstruction Via H2Optimization , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[48]  J. Zerubia,et al.  A Generalized Sampling Theory without bandlimiting constraints , 1998 .

[49]  A. J. Jerri Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[50]  Karl Johan Åström,et al.  Computer-Controlled Systems: Theory and Design , 1984 .

[51]  Thierry Blu,et al.  Cardinal exponential splines: part I - theory and filtering algorithms , 2005, IEEE Transactions on Signal Processing.

[52]  Bassam Bamieh,et al.  The H 2 problem for sampled-data systems m for sampled-data systems , 1992 .

[53]  Tongwen Chen,et al.  Design of multirate filter banks by /spl Hscr//sub /spl infin// optimization , 1995 .

[54]  M. Zwaan An introduction to hilbert space , 1990 .

[55]  LEONID MIRKIN,et al.  H2 and Hinfinity Design of Sampled-Data Systems Using Lifting. Part I: General Framework and Solutions , 1999, SIAM J. Control. Optim..

[56]  Pramod P. Khargonekar,et al.  Delayed signal reconstruction using sampled-data control , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[57]  K. Glover,et al.  A characterization of all solutions to the four block general distance problem , 1991 .

[58]  R. L. Stens,et al.  Sampling theory in Fourier and signal analysis : advanced topics , 1999 .

[59]  Akram Aldroubi,et al.  B-spline signal processing. II. Efficiency design and applications , 1993, IEEE Trans. Signal Process..