Gradient Profile Estimation Using Exponential Cubic Spline Smoothing in a Bayesian Framework

Attaining reliable gradient profiles is of utmost relevance for many physical systems. In many situations, the estimation of the gradient is inaccurate due to noise. It is common practice to first estimate the underlying system and then compute the gradient profile by taking the subsequent analytic derivative of the estimated system. The underlying system is often estimated by fitting or smoothing the data using other techniques. Taking the subsequent analytic derivative of an estimated function can be ill-posed. This becomes worse as the noise in the system increases. As a result, the uncertainty generated in the gradient estimate increases. In this paper, a theoretical framework for a method to estimate the gradient profile of discrete noisy data is presented. The method was developed within a Bayesian framework. Comprehensive numerical experiments were conducted on synthetic data at different levels of noise. The accuracy of the proposed method was quantified. Our findings suggest that the proposed gradient profile estimation method outperforms the state-of-the-art methods.

[1]  J. Canton.  An Essay towards solving a Problem in the Doctrine of Chances . By the late Rev . Mr . Bayes , communicated by Mr . Price , in a letter to , 1999 .

[2]  C. Reinsch.  Smoothing by spline functions , 1967 .

[3]  Ariel Caticha,et al.  Updating Probabilities with Data and Moments , 2007, ArXiv.

[4]  T. Bayes.  LII. An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, F. R. S. communicated by Mr. Price, in a letter to John Canton, A. M. F. R. S , 1763, Philosophical Transactions of the Royal Society of London.

[5]  G. Wahba,et al.  A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines , 1970 .

[6]  S. Wold.  Spline Functions in Data Analysis , 1974 .

[7]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[8]  G. Wahba.  Spline models for observational data , 1990 .

[9]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[10]  Dani Gamerman,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 1997 .

[11]  Dirk Lucas,et al.  On sampling bias in multiphase flows: Particle image velocimetry in bubbly flows , 2016 .

[12]  B. Silverman,et al.  Nonparametric Regression and Generalized Linear Models: A roughness penalty approach , 1993 .

[13]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[14]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[15]  Sean A. Ali,et al.  Application of the maximum relative entropy method to the physics of ferromagnetic materials , 2016, 1603.00068.

[16]  R. Kohn,et al.  Estimation, Filtering, and Smoothing in State Space Models with Incompletely Specified Initial Conditions , 1985 .

[17]  B. Silverman,et al.  Nonparametric Regression and Generalized Linear Models: A roughness penalty approach , 1993 .

[18]  Scott M. Berry,et al.  Bayesian Smoothing and Regression Splines for Measurement Error Problems , 2002 .

[19]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[20]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[21]  T. Bayes.  An essay towards solving a problem in the doctrine of chances , 2003 .

[22]  Luiz Paulo Lopes Fávero,et al.  Estimation , 2019, Data Science for Business and Decision Making.

[23]  P. Rentrop.  An algorithm for the computation of the exponential spline , 1980 .

[24]  S. E. Ahmed,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 2008, Technometrics.

[25]  V. Dose,et al.  Background estimation in experimental spectra , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Marta Tallarita,et al.  Bayesian splines versus fractional polynomials in network meta-analysis , 2020, BMC Medical Research Methodology.

[29]  E. Montoya,et al.  A Simulation Study Comparing Knot Selection Methods With Equally Spaced Knots in a Penalized Regression Spline , 2014 .

[30]  A. Mohammad-Djafari.  Bayesian inference for inverse problems , 2001, physics/0110093.

[31]  Volker Dose,et al.  Function Estimation Employing Exponential Splines , 2005 .

[32]  Mansfield Merriman.  A text book on the method of least squares , 1897 .

[33]  Volker Dose,et al.  Flexible and reliable profile estimation using exponential splines , 2006 .

[34]  B. Silverman,et al.  Some Aspects of the Spline Smoothing Approach to Non‐Parametric Regression Curve Fitting , 1985 .

[35]  U. Toussaint,et al.  DIGITAL PARTICLE IMAGE VELOCIMETRY USING SPLINES IN TENSION , 2011 .

[36]  John Skilling,et al.  Data analysis : a Bayesian tutorial , 1996 .

[37]  A. Dinklage,et al.  Non-parametric profile gradient estimation , 2006 .

[38]  M. Newton.  Approximate Bayesian-inference With the Weighted Likelihood Bootstrap , 1994 .

[39]  B. Liu,et al.  Errors in particle tracking velocimetry with high-speed cameras. , 2011, The Review of scientific instruments.

[40]  Ronald H. Brown,et al.  Analysis of algorithms for velocity estimation from discrete position versus time data , 1992, IEEE Trans. Ind. Electron..

[41]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[42]  Youssef M. Marzouk,et al.  Improved profile fitting and quantification of uncertainty in experimental measurements of impurity transport coefficients using Gaussian process regression , 2015 .

[43]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[44]  R. Tibshirani,et al.  Generalized Additive Models , 1986 .

[45]  G. Wahba.  Improper Priors, Spline Smoothing and the Problem of Guarding Against Model Errors in Regression , 1978 .