Gaining Insight into Evolutionary Programming Through Landscape Visualization: An Investigation into IIR Filtering

Evolutionary programming (EP) has been used for the adaptation (optimization) of IIR filters. In a previous study [1], the rate of optimization using EP was shown to be dependent on the structure of the filter used during realization. Furthermore, this dependency changes with the filter order. In this paper, the reasons for such a dependence are investigated. Gradient-based algorithms are also affected by the filter realization, which determines the nature of the mean squared error surface. EP is robust to the presence of local minima and while ensuring the stability of the generated solution offers provable global convergence in the limit. The error surfaces, as seen by EP, while modeling these IIR filters in various realizations, namely, direct, cascade, parallel, and lattice form are analyzed. Experimental results show that ‘gradient friendly’ error surfaces, corresponding to favorable realizations when using gradient based techniques, are not necessarily ‘EP friendly’ and vice versa.

[1]  Phillip A. Regalia,et al.  Stable and efficient lattice algorithms for adaptive IIR filtering , 1992, IEEE Trans. Signal Process..

[2]  David B. Fogel,et al.  Meta-evolutionary programming , 1991, [1991] Conference Record of the Twenty-Fifth Asilomar Conference on Signals, Systems & Computers.

[3]  T. Claasen,et al.  Effects of quantization and overflow in recursive digital filters , 1976 .

[4]  Qiang Ma,et al.  Genetic algorithms applied to the adaptation of IIR filters , 1996, Signal Process..

[5]  S. Stearns,et al.  An adaptive lattice algorithm for recursive filters , 1980 .

[6]  P. Mars,et al.  Genetic and annealing approaches to adaptive digital filtering , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[7]  W. Jenkins,et al.  A new adaptive IIR filter , 1986 .

[8]  L. Mcbride,et al.  A technique for the identification of linear systems , 1965 .

[9]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[10]  W. Kenneth Jenkins,et al.  Alternate realizations to adaptive IIR filters and properties of their performance surfaces , 1989 .