Functional Network Topology Learning and Sensitivity Analysis Based on ANOVA Decomposition

A new methodology for learning the topology of a functional network from data, based on the ANOVA decomposition technique, is presented. The method determines sensitivity (importance) indices that allow a decision to be made as to which set of interactions among variables is relevant and which is irrelevant to the problem under study. This immediately suggests the network topology to be used in a given problem. Moreover, local sensitivities to small changes in the data can be easily calculated. In this way, the dual optimization problem gives the local sensitivities. The methods are illustrated by their application to artificial and real examples.

[1]  I. Sobol.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[2]  A. Fielding.  Sensitivity Analysis in Linear Regression , 1990 .

[3]  Ali S. Hadi,et al.  Sensitivity analysis in statistics , 1994 .

[4]  Enrique Castillo,et al.  Nonlinear time series modeling and prediction using functional networks. Extracting information masked by chaos , 1998 .

[5]  Enrique Castillo,et al.  Functional Equations in Applied Sciences , 2004 .

[6]  R. Fisher.  XV.—The Correlation between Relatives on the Supposition of Mendelian Inheritance. , 1919, Transactions of the Royal Society of Edinburgh.

[7]  Oscar Fontenla-Romero,et al.  Functional Networks , 2009, Encyclopedia of Artificial Intelligence.

[8]  E. Castillo,et al.  Working with differential, functional and difference equations using functional networks , 1999 .

[9]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[10]  J. Aczél,et al.  Lectures on Functional Equations and Their Applications , 1968 .

[11]  T. J. Mitchell,et al.  Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments , 1991 .

[12]  Enrique F. Castillo,et al.  Sensitivity analysis in discrete Bayesian networks , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[13]  E. Buckingham.  On Physically Similar Systems; Illustrations of the Use of Dimensional Equations , 1914 .

[14]  Yoshimi Goda,et al.  Experiments on the Transition from Nonbreaking to Postbreaking Wave Pressures , 1972 .

[15]  B. Efron,et al.  The Jackknife Estimate of Variance , 1981 .

[16]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[17]  Art B. Owen,et al.  Quasi-regression with shrinkage , 2003, Math. Comput. Simul..

[18]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[19]  W. Hoeffding.  A Class of Statistics with Asymptotically Normal Distribution , 1948 .

[20]  S. Chatterjee.  Sensitivity analysis in linear regression , 1988 .

[21]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[22]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[23]  I. Sobol.  Global Sensitivity Indices for Nonlinear Mathematical Models , 2004 .

[24]  I. Sobol,et al.  Global sensitivity indices for nonlinear mathematical models. Review , 2005 .

[25]  E. Castillo,et al.  Functional Networks: A New Network‐Based Methodology , 2000 .

[26]  José Manuel Gutiérrez,et al.  SOME LEARNING METHODS IN FUNCTIONAL NETWORKS , 2000 .

[27]  Art B. Owen,et al.  9 Computer experiments , 1996, Design and analysis of experiments.

[28]  L. Penrose,et al.  THE CORRELATION BETWEEN RELATIVES ON THE SUPPOSITION OF MENDELIAN INHERITANCE , 2022 .

[29]  Joseph A. C. Delaney.  Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[30]  David Kendrick,et al.  GAMS, a user's guide , 1988, SGNM.