Low complexity metaheuristics for joint ML estimation problems

Abstract Joint maximum likelihood (ML) estimation of multiple parameters is an important problem with wide-spread relevance in many domains. The high computational complexity involved in joint ML problems has led to the search for more efficient methods. Efficient heuristic algorithms for joint ML problems can be developed by exploiting the characteristics of the objective functions used in the estimation problem. This paper proposes a novel reformulation of existing heuristic algorithms, which considerably reduces their computational complexity with significant improvement in performance. The method is applicable for joint maximum likelihood estimation problems, with cost functions that exhibit asymptotic separability with increase in observation vector size. The proposed method is adopted to five recently discovered heuristic algorithms and consequently applied to a relevant recent signal processing problem in wireless communication. It is found that the reformulated algorithms deliver both reduced computational complexity as well as better mean square error (MSE) performance. The significant features of the proposed method are substantiated through extensive computer simulation studies.

[1]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[2]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[3]  Fred W. Glover,et al.  Cyber Swarm Algorithms - Improving particle swarm optimization using adaptive memory strategies , 2010, Eur. J. Oper. Res..

[4]  G. Golub,et al.  Separable nonlinear least squares: the variable projection method and its applications , 2003 .

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  Ying Liu,et al.  An effective hybrid particle swarm optimization for batch scheduling of polypropylene processes , 2010, Comput. Chem. Eng..

[7]  Amit Konar,et al.  A swarm intelligence approach to the synthesis of two-dimensional IIR filters , 2007, Eng. Appl. Artif. Intell..

[8]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[9]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[10]  H. Qin,et al.  Aberration correction of a single aspheric lens with particle swarm algorithm , 2012 .

[11]  Fred W. Glover,et al.  A Complementary Cyber Swarm Algorithm , 2011, Int. J. Swarm Intell. Res..

[12]  A. Farina,et al.  Multiple radar targets estimation by exploiting induced amplitude modulation , 2003 .

[13]  Lei Xie,et al.  Particle swarm for the dynamic optimization of biochemical processes , 2006 .

[14]  Imtiaz Ahmad,et al.  Frequency assignment problem in satellite communications using differential evolution , 2010, Comput. Oper. Res..

[15]  Ivanoe De Falco,et al.  Differential Evolution as a viable tool for satellite image registration , 2008, Appl. Soft Comput..

[16]  Juan Gabriel Segovia-Hernández,et al.  Particle Swarm Optimization for Phase Stability and Equilibrium Calculations in Reactive Systems , 2009 .

[17]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[18]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[19]  Patrick Siarry,et al.  A hybrid method combining continuous tabu search and Nelder-Mead simplex algorithms for the global optimization of multiminima functions , 2005, Eur. J. Oper. Res..

[20]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[21]  Pinar Çivicioglu,et al.  Backtracking Search Optimization Algorithm for numerical optimization problems , 2013, Appl. Math. Comput..

[22]  C.-C. Jay Kuo,et al.  Synchronization Techniques for Orthogonal Frequency Division Multiple Access (OFDMA): A Tutorial Review , 2007, Proceedings of the IEEE.

[23]  C.-C. Jay Kuo,et al.  Maximum-likelihood synchronization and channel estimation for OFDMA uplink transmissions , 2006, IEEE Transactions on Communications.

[24]  E. Biscaia,et al.  The use of particle swarm optimization for dynamical analysis in chemical processes , 2002 .

[25]  Masao Fukushima,et al.  Tabu Search directed by direct search methods for nonlinear global optimization , 2006, Eur. J. Oper. Res..

[26]  Amrit Pal Singh,et al.  Comparative Study of Firefly Algorithm and Particle Swarm Optimization for Noisy Non- Linear Optimization Problems , 2012 .

[27]  Gang Xu,et al.  An adaptive parameter tuning of particle swarm optimization algorithm , 2013, Appl. Math. Comput..

[28]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[29]  Ilan Ziskind,et al.  Maximum likelihood localization of multiple sources by alternating projection , 1988, IEEE Trans. Acoust. Speech Signal Process..

[30]  Konstantinos E. Parsopoulos,et al.  Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method , 2002 .

[31]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[32]  Marco Dorigo,et al.  From Natural to Artificial Swarm Intelligence , 1999 .

[33]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[34]  Hossein Sameti,et al.  A novel approach to HMM-based speech recognition system using particle swarm optimization , 2009, 2009 Fourth International on Conference on Bio-Inspired Computing.

[35]  Pinar Civicioglu,et al.  Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm , 2012, Comput. Geosci..

[36]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[37]  Luca Maria Gambardella,et al.  A survey on metaheuristics for stochastic combinatorial optimization , 2009, Natural Computing.

[38]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.