Digital IIR Filter Design with Fix-Point Representation Using Effective Evolutionary Local Search Enhanced Differential Evolution

Previously, the parameters of digital IIR filters were encoded with floating-point representations. It is known that a fixed-point representation can effectively save computational resources and is more convenient for direct realization on hardware. Inherently, compared with floating-point representation, fixed-point representation may make the search space miss much useful gradient information and, therefore, raises new challenges. In this chapter, the universality of DE-based MA is improved by implementing more efficient evolutionary algorithms (EAs) as the local search techniques. The performance of the newly designed algorithm is experimentally verified in both function optimization tasks and digital IIR filter design problems.

[1]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[2]  Thomas Hanne,et al.  A multiobjective evolutionary algorithm for scheduling and inspection planning in software development projects , 2005, Eur. J. Oper. Res..

[3]  Jesuk Ko,et al.  A symbiotic evolutionary algorithm for the integration of process planning and job shop scheduling , 2003, Comput. Oper. Res..

[4]  Frank Neumann,et al.  Expected runtimes of evolutionary algorithms for the Eulerian cycle problem , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[5]  George Mavrotas,et al.  Solving multiobjective, multiconstraint knapsack problems using mathematical programming and evolutionary algorithms , 2010, Eur. J. Oper. Res..

[6]  Junchi Yan,et al.  Weighted sparse coding residual minimization for visual tracking , 2011, 2011 Visual Communications and Image Processing (VCIP).

[7]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Bin Li,et al.  A Self-adaptive Mixed Distribution Based Uni-variate Estimation of Distribution Algorithm for Large Scale Global Optimization , 2009, Nature-Inspired Algorithms for Optimisation.

[9]  Yew-Soon Ong,et al.  A Probabilistic Memetic Framework , 2009, IEEE Transactions on Evolutionary Computation.

[10]  Nurhan Karaboga,et al.  Artificial immune algorithm for IIR filter design , 2005, Eng. Appl. Artif. Intell..

[11]  Xin Yao,et al.  Pipe failure prediction: A data mining method , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[12]  Zhongbo Jiang,et al.  Detect irregularly shaped spatio-temporal clusters for decision support , 2011, Proceedings of 2011 IEEE International Conference on Service Operations, Logistics and Informatics.

[13]  Bin Li,et al.  Fixed-point digital IIR filter design using multi-objective optimization evolutionary algorithm , 2010, 2010 IEEE Youth Conference on Information, Computing and Telecommunications.

[14]  J. Shynk.  Adaptive IIR filtering , 1989, IEEE ASSP Magazine.

[15]  Junchi Yan,et al.  Two-stage based ensemble optimization framework for large-scale global optimization , 2013, Eur. J. Oper. Res..

[16]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[17]  Chi-Tsong Chen,et al.  One-Dimensional Digital Signal Processing , 1979 .

[18]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[19]  Xin Yao,et al.  Covariance matrix repairing in Gaussian based EDAs , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  P. Debye,et al.  Näherungsformeln für die Zylinderfunktionen für große Werte des Arguments und unbeschränkt veränderliche Werte des Index , 1909 .

[21]  M. J. Hicks,et al.  Recursive adaptive filter design using an adaptive genetic algorithm , 1982, ICASSP.

[22]  Kim-Fung Man,et al.  Design and optimization of IIR filter structure using hierarchical genetic algorithms , 1998, IEEE Trans. Ind. Electron..

[23]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[24]  L. Coelho,et al.  Combining of chaotic differential evolution and quadratic programming for economic dispatch optimization with valve-point effect , 2006, IEEE Transactions on Power Systems.

[25]  Chaohua Dai,et al.  Seeker Optimization Algorithm for Digital IIR Filter Design , 2010, IEEE Transactions on Industrial Electronics.

[26]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[27]  Xin Yao,et al.  NichingEDA: Utilizing the diversity inside a population of EDAs for continuous optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[28]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[29]  Caroline Prodhon,et al.  A hybrid evolutionary algorithm for the periodic location-routing problem , 2011, Eur. J. Oper. Res..

[30]  Pedro Larrañaga,et al.  GA-EDA: hybrid evolutionary algorithm using genetic and estimation of distribution algorithms , 2004 .

[31]  Jian Liu,et al.  Visual saliency detection via rank-sparsity decomposition , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Miki Haseyama,et al.  A filter coefficient quantization method with genetic algorithm, including simulated annealing , 2006, IEEE Signal Processing Letters.

[33]  Francisco Herrera,et al.  Adaptive local search parameters for real-coded memetic algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[34]  T. Warren Liao,et al.  Two hybrid differential evolution algorithms for engineering design optimization , 2010, Appl. Soft Comput..

[35]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[36]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[37]  D.J. Krusienski,et al.  Design and performance of adaptive systems based on structured stochastic optimization strategies , 2005, IEEE Circuits and Systems Magazine.

[38]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[39]  Shing-Tai Pan,et al.  A canonic-signed-digit coded genetic algorithm for designing finite impulse response digital filter , 2010, Digit. Signal Process..

[40]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[41]  James Smith,et al.  A tutorial for competent memetic algorithms: model, taxonomy, and design issues , 2005, IEEE Transactions on Evolutionary Computation.

[42]  Junchi Yan,et al.  Visual Saliency Detection via Sparsity Pursuit , 2010, IEEE Signal Processing Letters.

[43]  Bin Li,et al.  Estimation of distribution and differential evolution cooperation for real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[44]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[45]  Abel García-Nájera,et al.  An improved multi-objective evolutionary algorithm for the vehicle routing problem with time windows , 2011, Comput. Oper. Res..

[46]  Dervis Karaboga,et al.  Designing digital IIR filters using ant colony optimisation algorithm , 2004, Eng. Appl. Artif. Intell..

[47]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[48]  Thomas Hanne,et al.  A multiobjective evolutionary algorithm for approximating the efficient set , 2007, Eur. J. Oper. Res..

[49]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[50]  Yu Yang,et al.  Cooperative Coevolutionary Genetic Algorithm for Digital IIR Filter Design , 2007, IEEE Transactions on Industrial Electronics.

[51]  D. Quagliarella,et al.  Airfoil and wing design through hybrid optimization strategies , 1998 .

[52]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[53]  G. Vanuytsel,et al.  Efficient hybrid optimization of fixed-point cascaded IIR filter coefficients , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[54]  Wei Fan,et al.  A general framework to encode heterogeneous information sources for contextual pattern mining , 2012, CIKM.

[55]  Li Li,et al.  Discovery of generalized spatial association rules , 2012, Proceedings of 2012 IEEE International Conference on Service Operations and Logistics, and Informatics.

[56]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[57]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[58]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[59]  Tung-Kuan Liu,et al.  Optimal design of digital IIR filters by using hybrid taguchi genetic algorithm , 2006, IEEE Trans. Ind. Electron..

[60]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[61]  Ruhul A. Sarker,et al.  Memetic algorithms for solving job-shop scheduling problems , 2009, Memetic Comput..

[62]  Anne Auger,et al.  Performance evaluation of an advanced local search evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[63]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[64]  Kaushik Roy,et al.  Complexity reduction of digital filters using shift inclusive differential coefficients , 2004, IEEE Transactions on Signal Processing.

[65]  Ming-Hsuan Yang,et al.  Contour detection via random forest , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[66]  C. Houck,et al.  Utilizing Lamarckian Evolution and the Baldwin Effect in Hybrid Genetic Algorithms , 2007 .

[67]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[68]  N. Karaboga,et al.  A new method for adaptive IIR filter design based on tabu search algorithm , 2005 .

[69]  Bin Li,et al.  Estimation of distribution and differential evolution cooperation for large scale economic load dispatch optimization of power systems , 2010, Inf. Sci..

[70]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[71]  Yin Li,et al.  An Optimization Based Framework for Human Pose Estimation , 2010, IEEE Signal Processing Letters.

[72]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[73]  Jian Song,et al.  Model-based 3D human motion tracking and voxel reconstruction from sparse views , 2010, 2010 IEEE International Conference on Image Processing.

[74]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[75]  Ferrante Neri,et al.  Differential Evolution with Scale Factor Local Search for Large Scale Problems , 2010 .

[76]  Carlos García-Martínez,et al.  Hybrid metaheuristics with evolutionary algorithms specializing in intensification and diversification: Overview and progress report , 2010, Comput. Oper. Res..

[77]  Xin Yao,et al.  Unified eigen analysis on multivariate Gaussian based estimation of distribution algorithms , 2008, Inf. Sci..

[78]  Andrzej Tarczynski,et al.  A WISE method for designing IIR filters , 2001, IEEE Trans. Signal Process..

[79]  Kay Chen Tan,et al.  A hybrid multi-objective evolutionary algorithm for solving truck and trailer vehicle routing problems , 2006, Eur. J. Oper. Res..

[80]  Chi-Keong Goh,et al.  Computational Intelligence in Expensive Optimization Problems , 2010 .

[81]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[82]  Yin Li,et al.  An Accelerated Human Motion Tracking System Based on Voxel Reconstruction under Complex Environments , 2009, ACCV.

[83]  Emmanuel C. Ifeachor,et al.  Automatic design of frequency sampling filters by hybrid genetic algorithm techniques , 1998, IEEE Trans. Signal Process..

[84]  Hongyuan Zha,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Towards Effective Prioritizing Water Pipe Replacement and Rehabilitation ∗ , 2022 .

[85]  Felipe Albertao,et al.  Incremental dictionary learning for fault detection with applications to oil pipeline leakage detection , 2011 .

[86]  Ming-Hsuan Yang,et al.  Discriminative Generative Contour Detection , 2013, BMVC.

[87]  Patrick Reed,et al.  Comparative analysis of multiobjective evolutionary algorithms for random and correlated instances of multiobjective d-dimensional knapsack problems , 2011, Eur. J. Oper. Res..

[88]  Li Li,et al.  Detecting Irregularly Shaped Significant Spatial and Spatio-Temporal Clusters , 2012, SDM.

[89]  Ying Wang,et al.  An adaptive chaotic differential evolution for the short-term hydrothermal generation scheduling problem , 2010 .

[90]  Peter Tiño,et al.  Scaling Up Estimation of Distribution Algorithms for Continuous Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[91]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[92]  M. J. D. Powell,et al.  A Method for Minimizing a Sum of Squares of Non-Linear Functions Without Calculating Derivatives , 1965, Comput. J..

[93]  Philippe Fortemps,et al.  A hybrid rank-based evolutionary algorithm applied to multi-mode resource-constrained project scheduling problem , 2010, Eur. J. Oper. Res..

[94]  Youlin Lu,et al.  An adaptive hybrid differential evolution algorithm for dynamic economic dispatch with valve-point effects , 2010, Expert Syst. Appl..

[95]  Bin Li,et al.  Two-stage ensemble memetic algorithm: Function optimization and digital IIR filter design , 2013, Inf. Sci..

[96]  Bin Li,et al.  A restart univariate estimation of distribution algorithm: sampling under mixed Gaussian and Lévy probability distribution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).