Numerical differentiation: local versus global methods

In the context of the analysis of measured data, one is often faced with the task to differentiate data numerically. Typically, this occurs when measured data are concerned or data are evaluated numerically during the evolution of partial or ordinary differential equations. Usually, one does not take care for accuracy of the resulting estimates of derivatives because modern computers are assumed to be accurate to many digits. But measurements yield intrinsic errors, which are often much less accurate than the limit of the machine used, and there exists the effect of ``loss of significance'', well known in numerical mathematics and computational physics. The problem occurs primarily in numerical subtraction, and clearly, the estimation of derivatives involves the approximation of differences. In this article, we discuss several techniques for the estimation of derivatives. As a novel aspect, we divide into local and global methods, and explain the respective shortcomings. We have developed a general scheme for global methods, and illustrate our ideas by spline smoothing and spectral smoothing. The results from these less known techniques are confronted with the ones from local methods. As typical for the latter, we chose Savitzky-Golay filtering and finite differences. Two basic quantities are used for characterization of results: The variance of the difference of the true derivative and its estimate, and as important new characteristic, the smoothness of the estimate. We apply the different techniques to numerically produced data and demonstrate the application to data from an aeroacoustic experiment. As a result, we find that global methods are generally preferable if a smooth process is considered. For rough estimates local methods work acceptably well.

[1]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[2]  W. Härdle Applied Nonparametric Regression , 1991 .

[3]  J. L. Hudson,et al.  Synchronization of non-phase-coherent chaotic electrochemical oscillations. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  M. J. Bunner,et al.  Identification of continuous, spatiotemporal systems. , 1998 .

[5]  Jürgen Kurths,et al.  Additive nonparametric reconstruction of dynamical systems from time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[7]  A. Prasad Particle image velocimetry , 2000 .

[8]  B. Fabre,et al.  Physical modeling of flue instruments : A review of lumped models , 2000 .

[9]  H H Abel,et al.  Synchronization in the human cardiorespiratory system. , 1998, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[11]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[12]  Alessandro Torcini,et al.  A novel integration scheme for partial differential equations: an application to the complex Ginzburg-Landau equation , 1995, solv-int/9511003.

[13]  Y. Hon,et al.  Reconstruction of numerical derivatives from scattered noisy data , 2005 .

[14]  Chong Gu,et al.  Minimizing GCV/GML Scores with Multiple Smoothing Parameters via the Newton Method , 1991, SIAM J. Sci. Comput..

[15]  J. Stoer,et al.  Introduction to Numerical Analysis , 2002 .

[16]  G. Ferrigno,et al.  Comparison between the more recent techniques for smoothing and derivative assessment in biomechanics , 1992, Medical and Biological Engineering and Computing.

[17]  Steven W. Smith,et al.  The Scientist and Engineer's Guide to Digital Signal Processing , 1997 .

[18]  S. Bergweiler,et al.  Synchronization of organ pipes by means of air flow coupling: experimental observations and modeling , 2005 .

[19]  G. Wahba Spline models for observational data , 1990 .

[20]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[21]  B. Silverman,et al.  Nonparametric regression and generalized linear models , 1994 .

[22]  Markus Abel,et al.  Nonparametric Modeling and Spatiotemporal Dynamical Systems , 2002, Int. J. Bifurc. Chaos.

[23]  C. W. Groetsch,et al.  The theory of Tikhonov regularization for Fredholm equations of the first kind , 1984 .

[24]  Otmar Scherzer,et al.  Inverse Problems Light: Numerical Differentiation , 2001, Am. Math. Mon..

[25]  A. Aldroubi,et al.  Wavelets in Medicine and Biology , 1997 .

[26]  L. Trefethen,et al.  FINITE DIFFERENCE AND SPECTRAL METHODS FOR ORDINARY , 1996 .

[27]  Markus Hegland,et al.  For numerical differentiation, dimensionality can be a blessing! , 1999, Math. Comput..