Numerical differentiation of experimental data: local versus global methods

Abstract In the context of the analysis of measured data, one is often faced with the task to differentiate data numerically. Typically, this occurs when measured data are concerned or data are evaluated numerically during the evolution of partial or ordinary differential equations. Usually, one does not take care for accuracy of the resulting estimates of derivatives because modern computers are assumed to be accurate to many digits. But measurements yield intrinsic errors, which are often much less accurate than the limit of the machine used, and there exists the effect of “loss of significance”, well known in numerical mathematics and computational physics. The problem occurs primarily in numerical subtraction, and clearly, the estimation of derivatives involves the approximation of differences. In this article, we discuss several techniques for the estimation of derivatives. As a novel aspect, we divide into local and global methods, and explain the respective shortcomings. We have developed a general scheme for global methods, and illustrate our ideas by spline smoothing and spectral smoothing. The results from these less known techniques are confronted with the ones from local methods. As typical for the latter, we chose Savitzky–Golay-filtering and finite differences. Two basic quantities are used for characterization of results: The variance of the difference of the true derivative and its estimate, and as important new characteristic, the smoothness of the estimate. We apply the different techniques to numerically produced data and demonstrate the application to data from an aeroacoustic experiment. As a result, we find that global methods are generally preferable if a smooth process is considered. For rough estimates local methods work acceptably well.

[1]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[2]  A. Aldroubi,et al.  Wavelets in Medicine and Biology , 1997 .

[3]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[4]  J. L. Hudson,et al.  Synchronization of non-phase-coherent chaotic electrochemical oscillations. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Henry D. I. Abarbanel,et al.  Analysis of Observed Chaotic Data , 1995 .

[6]  Markus Hegland,et al.  For numerical differentiation, dimensionality can be a blessing! , 1999, Math. Comput..

[7]  A. Prasad Particle image velocimetry , 2000 .

[8]  Jürgen Kurths,et al.  Additive nonparametric reconstruction of dynamical systems from time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  H H Abel,et al.  Synchronization in the human cardiorespiratory system. , 1998, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  R. Landau,et al.  Numerical Differentiation , 2019, Numerical Methods.

[11]  Wolfgang Härdle,et al.  Applied Nonparametric Regression , 1991 .

[12]  C. W. Groetsch,et al.  The theory of Tikhonov regularization for Fredholm equations of the first kind , 1984 .

[13]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[14]  Chong Gu,et al.  Minimizing GCV/GML Scores with Multiple Smoothing Parameters via the Newton Method , 1991, SIAM J. Sci. Comput..

[15]  M Abel,et al.  Synchronization of organ pipes: experimental observations and modeling. , 2006, The Journal of the Acoustical Society of America.

[16]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[17]  G. Ferrigno,et al.  Comparison between the more recent techniques for smoothing and derivative assessment in biomechanics , 1992, Medical and Biological Engineering and Computing.

[18]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[19]  J. Stoer,et al.  Introduction to Numerical Analysis , 2002 .

[20]  L. Lourenço Particle Image Velocimetry , 1989 .

[21]  P. Bloomfield,et al.  Numerical differentiation procedures for non-exact data , 1974 .

[22]  J. Cullum Numerical Differentiation and Regularization , 1971 .

[23]  M. J. Bunner,et al.  Identification of continuous, spatiotemporal systems. , 1998 .

[24]  B. Fabre,et al.  Physical modeling of flue instruments : A review of lumped models , 2000 .

[25]  S. Bergweiler,et al.  Synchronization of organ pipes by means of air flow coupling: experimental observations and modeling , 2005 .

[26]  Matthias Holschneider,et al.  Wavelets - an analysis tool , 1995, Oxford mathematical monographs.

[27]  L. Trefethen Finite Difference and Spectral Methods for Ordinary and Partial Differential Equations , 1996 .

[28]  Alessandro Torcini,et al.  A novel integration scheme for partial differential equations: an application to the complex Ginzburg-Landau equation , 1995, solv-int/9511003.

[29]  Angelo Vulpiani,et al.  Dynamical Systems Approach to Turbulence , 1998 .

[30]  B. Silverman,et al.  Nonparametric regression and generalized linear models , 1994 .

[31]  Y. Hon,et al.  Reconstruction of numerical derivatives from scattered noisy data , 2005 .

[32]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[33]  Joel H. Ferziger,et al.  Computational methods for fluid dynamics , 1996 .

[34]  Steven W. Smith,et al.  The Scientist and Engineer's Guide to Digital Signal Processing , 1997 .

[35]  Markus Abel,et al.  Nonparametric Modeling and Spatiotemporal Dynamical Systems , 2002, Int. J. Bifurc. Chaos.

[36]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[37]  Otmar Scherzer,et al.  Inverse Problems Light: Numerical Differentiation , 2001, Am. Math. Mon..

[38]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[39]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[40]  James D. Meiss,et al.  Stochastic dynamical systems , 1994 .