Fixed-point digital IIR filter design using two-stage ensemble evolutionary algorithm

The research on optimal design of infinite-impulse response (IIR) filter design based on various optimization techniques, including evolutionary algorithms (EAs), has gained much attention in recent years. Previously, the parameters of digital IIR filters are encoded with floating-point representations. It is known that a fixed-point representation can effectively save computational resources and is more convenient for direct realization on hardware. Inherently, compared with the floating-point representation, the fixed-point representation would make the search space miss much useful gradient information and therefore, surely rises new challenges for continuous EAs. In this paper, we first analyze the fitness landscape properties of optimal digital IIR filter design. Based on the fitness landscape investigation, a two-stage ensemble evolutionary algorithm (TEEA) is applied to digital IIR filter design with fixed-point representation. In order to fully evaluate the performance of TEEA, we experimentally compare it with five state-of-the-art EAs on four types of digital IIR filters with different settings. Based on the experimental results, we can conclude that TEEA has higher convergence speed, better exploration, and higher success rate. In order to benchmark TEEA further, we apply it to some more difficult problems with shorter word length or higher order. We can find that TEEA can provide satisfying performance on these hard tasks as well.

[1]  G. Vanuytsel,et al.  Efficient hybrid optimization of fixed-point cascaded IIR filter coefficients , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[2]  Bin Li,et al.  Fixed-point digital IIR filter design using multi-objective optimization evolutionary algorithm , 2010, 2010 IEEE Youth Conference on Information, Computing and Telecommunications.

[3]  Pedro Larrañaga,et al.  Optimization in Continuous Domains by Learning and Simulation of Gaussian Networks , 2000 .

[4]  Ponnuthurai N. Suganthan,et al.  Ensemble strategies with adaptive evolutionary programming , 2010, Inf. Sci..

[5]  Miki Haseyama,et al.  A filter coefficient quantization method with genetic algorithm, including simulated annealing , 2006, IEEE Signal Processing Letters.

[6]  Marcus Gallagher,et al.  Experimental results for the special session on real-parameter optimization at CEC 2005: a simple, continuous EDA , 2005, 2005 IEEE Congress on Evolutionary Computation.

[7]  Tung-Kuan Liu,et al.  Optimal design of digital IIR filters by using hybrid taguchi genetic algorithm , 2006, IEEE Trans. Ind. Electron..

[8]  Kaushik Roy,et al.  Complexity reduction of digital filters using shift inclusive differential coefficients , 2004, IEEE Transactions on Signal Processing.

[9]  Shing-Tai Pan,et al.  A canonic-signed-digit coded genetic algorithm for designing finite impulse response digital filter , 2010, Digit. Signal Process..

[10]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[11]  J. Shynk Adaptive IIR filtering , 1989, IEEE ASSP Magazine.

[12]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[13]  Pedro Larrañaga,et al.  A Review on Estimation of Distribution Algorithms , 2002, Estimation of Distribution Algorithms.

[14]  K. Mondal,et al.  Analog and digital filters: Design and realization , 1980, Proceedings of the IEEE.

[15]  Chi-Tsong Chen,et al.  One-Dimensional Digital Signal Processing , 1979 .

[16]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[17]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Xin Yao,et al.  Evolutionary Design of Digital Filters With Application to Subband Coding and Data Transmission , 2007, IEEE Transactions on Signal Processing.

[19]  D.J. Krusienski,et al.  Design and performance of adaptive systems based on structured stochastic optimization strategies , 2005, IEEE Circuits and Systems Magazine.

[20]  N. Karaboga,et al.  A new method for adaptive IIR filter design based on tabu search algorithm , 2005 .

[21]  Jyh-Horng Chou,et al.  Design of Optimal Digital IIR Filters by Using an Improved Immune Algorithm , 2006, IEEE Transactions on Signal Processing.

[22]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[23]  Dervis Karaboga,et al.  Designing digital IIR filters using ant colony optimisation algorithm , 2004, Eng. Appl. Artif. Intell..

[24]  Bin Li,et al.  Estimation of distribution and differential evolution cooperation for large scale economic load dispatch optimization of power systems , 2010, Inf. Sci..

[25]  Andrzej Tarczynski,et al.  A WISE method for designing IIR filters , 2001, IEEE Trans. Signal Process..

[26]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[27]  Emmanuel C. Ifeachor,et al.  Automatic design of frequency sampling filters by hybrid genetic algorithm techniques , 1998, IEEE Trans. Signal Process..

[28]  M. J. Hicks,et al.  Recursive adaptive filter design using an adaptive genetic algorithm , 1982, ICASSP.

[29]  Kim-Fung Man,et al.  Design and optimization of IIR filter structure using hierarchical genetic algorithms , 1998, IEEE Trans. Ind. Electron..

[30]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[31]  Bin Li,et al.  Variance priority based cooperative co-evolution differential evolution for large scale global optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[32]  Chaohua Dai,et al.  Seeker Optimization Algorithm for Digital IIR Filter Design , 2010, IEEE Transactions on Industrial Electronics.

[33]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[34]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[35]  Yu Yang,et al.  Cooperative Coevolutionary Genetic Algorithm for Digital IIR Filter Design , 2007, IEEE Transactions on Industrial Electronics.

[36]  María S. Pérez-Hernández,et al.  GA-EDA: A New Hybrid Cooperative Search Evolutionary Algorithm , 2006, Towards a New Evolutionary Computation.

[37]  Nurhan Karaboga,et al.  Artificial immune algorithm for IIR filter design , 2005, Eng. Appl. Artif. Intell..

[38]  Bin Li,et al.  A Self-adaptive Mixed Distribution Based Uni-variate Estimation of Distribution Algorithm for Large Scale Global Optimization , 2009, Nature-Inspired Algorithms for Optimisation.