Density Estimation with Genetic Programming for Inverse Problem Solving

This paper addresses the resolution, by Genetic Programming (GP) methods, of ambiguous inverse problems, where for a single input, many outputs can be expected. We propose two approaches to tackle this kind of many-to-one inversion problems, each of them based on the estimation, by a team of predictors, of a probability density of the expected outputs. In the first one, Stochastic Realisation GP, the predictors outputs are considered as the realisations of an unknown random variable which distribution should approach the expected one. The second one, Mixture Density GP, directly models the expected distribution by the mean of a Gaussian mixture model, for which genetic programming has to find the parameters. Encouraging results are obtained on four test problems of different difficulty, exhibiting the interests of such methods.

[1]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[2]  C. Bishop Mixture density networks , 1994 .

[3]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .

[4]  S. R. Meier,et al.  Reflectance and scattering properties of highly absorbing black appliqués over a broadband spectral region. , 2001, Applied optics.

[5]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[6]  Lee Spector,et al.  Autoconstructive Evolution: Push, PushGP, and Pushpop , 2001 .

[7]  M. Chami,et al.  Inversion of oceanic constituents in case I and II waters with genetic programming algorithms. , 2002, Applied optics.

[8]  Wolfgang Banzhaf,et al.  Evolving Teams of Predictors with Linear Genetic Programming , 2001, Genetic Programming and Evolvable Machines.

[9]  Marc Schoenauer,et al.  Polar IFS+Parisian Genetic Programming=Efficient IFS Inverse Problem Solving , 2000, Genetic Programming and Evolvable Machines.

[10]  Philippe Collard,et al.  Teams of Genetic Predictors for Inverse Problem Solving , 2005, EuroGP.

[11]  Andreas Zell,et al.  Comparing Genetic Programming and Evolution Strategies on Inferring Gene Regulatory Networks , 2004, GECCO.

[12]  Isao Ono,et al.  Finding multiple solutions based on an evolutionary algorithm for inference of genetic networks by S-system , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[13]  A. Tarantola Inverse problem theory : methods for data fitting and model parameter estimation , 1987 .

[14]  Cyril Fonlupt,et al.  Genetic Programming with Boosting for Ambiguities in Regression Problems , 2003, EuroGP.