A binary search algorithm for univariate data approximation and estimation of extrema by piecewise monotonic constraints

The piecewise monotonic approximation problem makes the least changes to n univariate noisy data so that the piecewise linear interpolant to the new values is composed of at most k monotonic sections. The term “least changes” is defined in the sense of a global sum of strictly convex functions of changes. The main difficulty in this calculation is that the extrema of the interpolant have to be found automatically, but the number of all possible combinations of extrema can be $${\mathcal {O}}(n^{k-1})$$ , which makes not practicable to test each one separately. It is known that the case $$k=1$$ is straightforward, and that the case $$k>1$$ reduces to partitioning the data into at most k disjoint sets of adjacent data and solving a $$k=1$$ problem for each set. Some ordering relations of the extrema are studied that establish three quite efficient algorithms by using a binary search method for partitioning the data. In the least squares case the total work is only $${\mathcal {O}}(n \sigma +k\sigma \log _2\sigma )$$ computer operations when $$k \ge 3$$ and is only $${\mathcal {O}}(n)$$ when $$k=1$$ or 2, where $$\sigma -2$$ is the number of sign changes in the sequence of the first differences of the data. Fortran software has been written for this case and the numerical results indicate superior performance to existing algorithms. Some examples with real data illustrate the method. Many applications of the method arise from bioinformatics, energy, geophysics, medical imaging, and peak finding in spectroscopy, for instance.

[1]  Athanasios G. Lazaropoulos Capacity Performance of Overhead Transmission Multiple-Input Multiple-Output Broadband over Power Lines Networks: The Insidious Effect of Noise and the Role of Noise Models , 2016 .

[2]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[3]  P. Perron,et al.  Trends and random walks in macroeconomic time series : Further evidence from a new approach , 1988 .

[4]  Anand Srivastav,et al.  Error assessment of biogeochemical models by lower bound methods (NOMMA-1.0) , 2018 .

[5]  Gerard Ledwich,et al.  Identification scheme of maximum traction force using recursive least square for traction control in electric locomotives , 2017, 2017 IEEE 12th International Conference on Power Electronics and Drive Systems (PEDS).

[6]  Boris Goldengorin,et al.  Requirements of Standards: Optimization Models and Algorithms , 1995 .

[7]  Ioannis C. Demetriou,et al.  Signs of divided differences yield least squares data fitting with constrained monotonicity or convexity , 2002 .

[8]  Athanasios G. Lazaropoulos,et al.  Measurement Differences, Faults and Instabilities in Intelligent Energy Systems - Part 2: Fault and Instability Prediction in Overhead High-Voltage Broadband over Power Lines Networks by Applying Fault and Instability Identification Methodology (FIIM) , 2016 .

[9]  H. D. Brunk,et al.  Statistical inference under order restrictions : the theory and application of isotonic regression , 1973 .

[10]  Richard L. McCreery,et al.  Raman Spectroscopy for Chemical Analysis , 2000 .

[11]  John B. Weaver,et al.  Applications of monotonic noise reduction algorithms in fMRI, phase estimation, and contrast enhancement , 1999, Int. J. Imaging Syst. Technol..

[12]  M. A. Jiménez,et al.  Approximation and Optimization , 1989, Springer Optimization and Its Applications.

[13]  Athanasios G. Lazaropoulos Measurement Differences, Faults and Instabilities in Intelligent Energy Systems – Part 1: Identification of Overhead High-Voltage Broadband over Power Lines Network Topologies by Applying Topology Identification Methodology (TIM) , 2016 .

[14]  C. Nelson,et al.  Trends and random walks in macroeconmic time series: Some evidence and implications , 1982 .

[15]  F. T. Wright,et al.  Order restricted statistical inference , 1988 .

[16]  Val M. Runge,et al.  The Physics of Clinical MR Taught Through Images , 2007, American Journal of Neuroradiology.

[17]  Sami K. Solanki,et al.  Sunspots: An overview , 2003 .

[18]  J. Kalbfleisch Statistical Inference Under Order Restrictions , 1975 .

[19]  Johannes O. Royset,et al.  On univariate function identification problems , 2018, Math. Program..

[20]  M. J. D. Powell,et al.  Least Squares Smoothing of Univariate Data to achieve Piecewise Monotonicity , 1991 .

[21]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[22]  Ioannis C. Demetriou,et al.  An adaptive algorithm for least squares piecewise monotonic data fitting , 2005, Comput. Stat. Data Anal..

[23]  I. C. Demetriou Discrete piecewise monotonic approximation by a strictly convex distance function , 1995 .

[24]  R. Fletcher Practical Methods of Optimization , 1988 .

[25]  W. B.,et al.  The Calculus of Observations: a Treatise on Numerical Mathematics , 1924, Nature.

[26]  Ioannis C. Demetriou,et al.  A characterization theorem for the discrete best monotonic approximation problem , 1990 .

[27]  Ya-Xiang Yuan,et al.  Optimization theory and methods , 2006 .

[28]  I. C. Demetriou Separation theorems for the extrema of best piecewise monotonic approximations to successive data , 2020, Optim. Methods Softw..

[29]  Wayne H. Enright,et al.  Robust and reliable defect control for Runge-Kutta methods , 2007, TOMS.

[30]  Athanasios G. Lazaropoulos,et al.  Smart Energy and Spectral Efficiency (SE) of Distribution Broadband over Power Lines (BPL) Networks – Part 2: L1PMA, L2WPMA and L2CXCV for SE against Measurement Differences in Overhead Medium-Voltage BPL Networks , 2018, Trends in Renewable Energy.

[31]  Ioannis C. Demetriou,et al.  ALGORITHM XXX : L 2 WPMA , A FORTRAN 77 PACKAGE FOR WEIGHTED LEAST SQUARES PIECEWISE MONOTONIC DATA APPROXIMATION , 2006 .

[32]  N. Dyson,et al.  Chromatographic Integration Methods , 1990 .

[33]  I. C. Demetriou A Decomposition Theorem for the Least Squares Piecewise Monotonic Data Approximation Problem , 2019, Approximation and Optimization.

[34]  Jian Lu,et al.  Signal restoration with controlled piecewise monotonicity constraint , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[35]  Paul Dierckx,et al.  Curve and surface fitting with splines , 1994, Monographs on numerical analysis.

[36]  R. McCreery,et al.  Raman Spectroscopy for Chemical Analysis: McCreery/Raman Spectroscopy , 2005 .

[37]  Constance Van Eeden Maximum Likelihood Estimation Of Ordered Probabilities1) , 1956 .

[38]  Walter Krämer,et al.  Recursive computation of piecewise constant volatilities , 2012, Comput. Stat. Data Anal..

[39]  Structural Identification of Static Systems with Distributed Lags , 2013 .

[40]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .