An efficient optimizer for simple point process models

In this paper we discuss the main characteristics (that we consider to be essential) for the design of an efficient optimizer in the context of highly non-convex functions. We consider a specific model known as Marked Point Process (MPP). Given that the probability density is multimodal, and given the size of the configuration space, an exploration phase is essential at the beginning of the algorithm. Next, the fine details of the density function should be discovered. We propose efficient kernels to efficiently explore the different modes of the density, and other kernels to discover the details of each mode. We study the algorithm theoretically to express convergence speeds and to select its best parameters. We also present a simple and generic method to parallelize the optimization of a specific class of MPP models. We validate our ideas first on synthetic data of configurations of different sizes to prove the efficiency of the proposed kernels. Finally we present results on three different applications.

[1]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[2]  H. Kesten Percolation theory for mathematicians , 1982 .

[3]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[4]  C. Geyer,et al.  Simulation Procedures and Likelihood Inference for Spatial Point Processes , 1994 .

[5]  Xavier Descombes,et al.  Author manuscript, published in "Journal of Mathematical Imaging and Vision (2009)" Object , 2008 .

[6]  Josiane Zerubia,et al.  Forest Resource Assessment using Stochastic Geometry , 2006 .

[7]  Josiane Zerubia,et al.  A fast Multiple Birth and Cut algorithm using belief propagation , 2011, 2011 18th IEEE International Conference on Image Processing.

[8]  Christophe Andrieu,et al.  Joint Bayesian model selection and estimation of noisy sinusoids via reversible jump MCMC , 1999, IEEE Trans. Signal Process..

[9]  Tat-Jen Cham,et al.  Fast polygonal integration and its application in extending haar-like features to improve object detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Josiane Zerubia,et al.  Multiple Birth and Cut Algorithm for Point Process Optimization , 2010, 2010 Sixth International Conference on Signal-Image Technology and Internet Based Systems.

[12]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[13]  Olga Veksler,et al.  Markov random fields with efficient approximations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[14]  Josiane Zerubia,et al.  PARAMETER ESTIMATION FOR A MARKED POINT PROCESS WITHIN A FRAMEWORK OF MULTIDIMENSIONAL SHAPE EXTRACTION FROM REMOTE SENSING IMAGES , 2010 .