Optimization of LMS Algorithm for Adaptive Filtering using Global Optimization Techniques

filtering is a growing area of research due to its vast no of application in many fields and its numerous advantages over non adaptive filters. In fact there are many areas where the use of adaptive filters is becoming mandatory. Few of them are System Identification, Inverse Modeling, Linear Prediction, Feedforward Control etc. although enough work has been carried out on adaptive filters, still there are many fields where we can make significant contribution .One is the developing adaptive filtering for systems which are having a multimodal error surface, like IIR filters as gradient based optimization techniques, which are used so far in the designing of these type of system get stuck to The multi- modal error surface of these system and causes the gradient based algorithms to be stuck at local minima and not converge to the global optimum, resulting in an unstable system. In this work, we have combined the advantages of both gradient based algorithm and global optimizations algorithm to make the adaptive filters capable of efficiently working for the system having multimodal error surface. In this new method we use LMS as gradient based algorithm and Ant Colony Optimization (ACO) & Particle swarm optimization (PSO) as global optimization algorithm. In which ACO take inspiration from the behavior of real ant colonies to solve this type of optimization problems and PSO is a population based stochastic optimization technique developed by Dr. Eberhart and Dr. Kennedy in 1995, inspired by social behavior of bird flocking or fish schooling. The algorithm is implemented using MATLAB, and the simulation results obtained shows that the proposed approaches is quite efficient, accurate and has a fast convergence rate. The results obtained also demonstrate that the proposed method can be efficiently used in designing and identification of systems having multimodal error surface.

[1]  Bing Lam Luk,et al.  Adaptive simulated annealing for optimization in signal processing applications , 1999, Signal Process..

[2]  Hsin-Yun Lee,et al.  Decision support for the maintenance management of green areas , 2010, Expert Syst. Appl..

[3]  Ali Maroosi,et al.  A new clustering algorithm based on hybrid global optimizationbased on a dynamical systems approach algorithm , 2010, Expert Syst. Appl..

[4]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[5]  Nurhan Karaboga,et al.  A parallel tabu search algorithm for digital filter design , 2005 .

[6]  Frank Neumann,et al.  Ant Colony Optimization and the minimum spanning tree problem , 2006, Theor. Comput. Sci..

[7]  KarabogaNurhan Digital IIR filter design using differential evolution algorithm , 2005 .

[8]  Juanjuan Hu,et al.  An Improved Ant Colony Optimization for Flexible Job Shop Scheduling Problems , 2011 .

[9]  S. Hranilovic,et al.  Performance analysis of noise cancellation in a diversity combined ACO-OFDM system , 2012, 2012 14th International Conference on Transparent Optical Networks (ICTON).

[10]  Deman Kosale,et al.  Optimized Variable Step Size Normalized LMS Adaptive Algorithm for Echo Cancellation , 2015 .

[11]  D.J. Krusienski,et al.  Design and performance of adaptive systems based on structured stochastic optimization strategies , 2005, IEEE Circuits and Systems Magazine.

[12]  Shu-Hung Leung,et al.  The genetic search approach. A new learning algorithm for adaptive IIR filtering , 1996, IEEE Signal Process. Mag..

[13]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[14]  S. Theodoridis Adaptive filtering algorithms , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[15]  Nurhan Karaboga,et al.  Design of Digital FIR Filters Using Differential Evolution Algorithm , 2006 .

[16]  Dervis Karaboga,et al.  Designing digital IIR filters using ant colony optimisation algorithm , 2004, Eng. Appl. Artif. Intell..

[17]  Dean J. Krusienski,et al.  Particle swarm optimization for adaptive IIR filter structures , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[18]  J. Deneubourg,et al.  Self-organized shortcuts in the Argentine ant , 1989, Naturwissenschaften.

[19]  Peng Wang,et al.  A Knowledge-Based Ant Colony Optimization for Flexible Job Shop Scheduling Problems , 2010, Appl. Soft Comput..

[20]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[21]  Nurhan Karaboga,et al.  A new design method based on artificial bee colony algorithm for digital IIR filters , 2009, J. Frankl. Inst..

[22]  Kwang Mong Sim,et al.  Ant colony optimization for routing and load-balancing: survey and new directions , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[23]  N. Karaboga,et al.  A new method for adaptive IIR filter design based on tabu search algorithm , 2005 .

[24]  Nurhan Karaboga,et al.  Digital IIR Filter Design Using Differential Evolution Algorithm , 2005, EURASIP J. Adv. Signal Process..

[25]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.