Evolutionary computation for optimal knots allocation in smoothing splines

Abstract In this paper, a novel methodology is presented for optimal placement and selections of knots, for approximating or fitting curves to data, using smoothing splines. It is well-known that the placement of the knots in smoothing spline approximation has an important and considerable effect on the behavior of the final approximation [1] . However, as pointed out in [2] , although spline for approximation is well understood, the knot placement problem has not been dealt with adequately. In the specialized bibliography, several methodologies have been presented for selection and optimization of parameters within B-spline, using techniques based on selecting knots called dominant points , adaptive knots placement, by data selection process, optimal control over the knots, and recently, by using paradigms from computational intelligent, and Bayesian model for automatically determining knot placement in spline modeling. However, a common two-step knot selection strategy, frequently used in the bibliography, is an homogeneous distribution of the knots or equally spaced approach [3] . In order to optimize the placement and numbers of knots required for approximation using smoothing splines, an Evolutionary Computation Paradigms ( ECP ) based on a Multi-Objective Genetic Algorithm has been developed, with the main purpose of avoiding the large number of local minima (in terms of approximation error for different system complexity or number of knots) existing in the problem of knots placement. The accuracy, computationally efficient and robustness of the algorithm presented will be compared by different experimental results, with other approaches presented in the bibliography, showing the main advantages of the proposed methodology.

[1]  A. F. de Vos,et al.  A synopsis of the smoothing formulae associated with the Kalman filter , 1993 .

[2]  Michel Bercovier,et al.  Spline Curve Approximation and Design by Optimal Control Over the Knots , 2004, Computing.

[3]  Sunil Kumar,et al.  A Parameter-Uniform B-Spline Collocation Method for Singularly Perturbed Semilinear Reaction-Diffusion Problems , 2010 .

[4]  Hyungjun Park,et al.  An error-bounded approximate method for representing planar curves in B-splines , 2004, Comput. Aided Geom. Des..

[5]  Josef Hoschek,et al.  Fundamentals of computer aided geometric design , 1996 .

[6]  Wenping Wang,et al.  Control point adjustment for B-spline curve approximation , 2004, Comput. Aided Des..

[7]  Erkan Ülker,et al.  An Artificial Immune System Approach for B-Spline Surface Approximation Problem , 2007, International Conference on Computational Science.

[8]  Rene F. Swarttouw,et al.  Orthogonal polynomials , 2020, NIST Handbook of Mathematical Functions.

[9]  Prem Kalra,et al.  Parameter optimization for B-spline curve fitting using genetic algorithms , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[11]  Ming-Chih Huang,et al.  The Pre-Processing of Data Points for Curve Fitting in Reverse Engineering , 2000 .

[12]  Toshinobu Harada,et al.  Automatic knot placement by a genetic algorithm for data fitting with a spline , 1999, Proceedings Shape Modeling International '99. International Conference on Shape Modeling and Applications.

[13]  Zulfiqar Habib,et al.  Rational cubic spline interpolation with shape control , 2005, Comput. Graph..

[14]  Chia-Hsiang Menq,et al.  Parameter optimization in approximating curves and surfaces to measurement data , 1991, Comput. Aided Geom. Des..

[15]  Hyungjun Park,et al.  B-spline curve fitting based on adaptive curve refinement using dominant points , 2007, Comput. Aided Des..

[16]  Young K. Truong,et al.  Polynomial splines and their tensor products in extended linearmodeling , 1997 .

[17]  Pascal Ray,et al.  Bspline approximation of circle arc and straight line for pocket machining , 2010, Comput. Aided Des..

[18]  Weishi Li,et al.  A Heuristic Knot Placement Algorithm for B-Spline Curve Approximation , 2004 .

[19]  M. L. Rodríguez,et al.  An approximation method with data selection process , 2009, Math. Comput. Simul..

[20]  Gang Zhao,et al.  Adaptive knot placement in B-spline curve approximation , 2005, Comput. Aided Des..

[21]  G. Ris,et al.  Continuity of biparametric surface patches , 1976 .

[22]  M. Sarfraz,et al.  Computer-aided reverse engineering using simulated evolution on NURBS , 2006 .

[23]  Muhammad Sarfraz,et al.  Computing Optimized Curves with NURBS Using Evolutionary Intelligence , 2005, ICCSA.

[24]  Mohammed Bennamoun,et al.  Automatic Bayesian knot placement for spline fitting , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[25]  Muhammad Sarfraz,et al.  Automatic outline capture of Arabic fonts , 2002, Inf. Sci..

[26]  Young K. Truong,et al.  Polynomial splines and their tensor products in extended linear modeling: 1994 Wald memorial lecture , 1997 .

[27]  J. Friedman Multivariate adaptive regression splines , 1990 .

[28]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[29]  Miguel Pasadas,et al.  Using simulated annealing for knot placement for cubic spline approximation , 2010 .

[30]  Caiming Zhang,et al.  Adaptive knot placement using a GMM-based continuous optimization algorithm in B-spline curve approximation , 2011, Comput. Aided Des..

[31]  Ahmet Arslan,et al.  Automatic knot adjustment using an artificial immune system for B-spline curve approximation , 2009, Inf. Sci..

[32]  D. Ruppert Selecting the Number of Knots for Penalized Splines , 2002 .

[33]  C. Reinsch Smoothing by spline functions , 1967 .