Adaptive signal processing: A discussion of trade-offs from the perspective of artificial learning

Since many signal processing problems can be posed as sample-based decision and estimation tasks, we discuss how studies from other fields such as neural networks might suggest improved architectures (models) and algorithms for these types of problems. We then concentrate on PAM equalization, showing that a reordering of the equivalent classification problem generates a ‘staircase’ which, while retaining the simplicity of the classical equalizer, allows modifications to made in the outputs and in the training objectives which provide advantages even in the least complex cases. We go on to demonstrate that these advantages increase when one considers, for example, nonlinear channels with memory. From our simulations we draw conclusions and suggest futher related research. We also present two new avenues of inquiry, offering significant practical advantages, which are motivated by the discussions.

[1]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[2]  C.F.N. Cowan,et al.  The application of nonlinear structures to the reconstruction of binary signals , 1991, IEEE Trans. Signal Process..

[3]  Sheng Chen,et al.  A clustering technique for digital communications channel equalization using radial basis function networks , 1993, IEEE Trans. Neural Networks.

[4]  J J Hopfield,et al.  Learning algorithms and probability distributions in feed-forward and feed-back networks. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Jesús Cid-Sueiro,et al.  Recurrent radial basis function networks for optimal symbol-by-symbol equalization , 1994, Signal Process..

[6]  Brian A. Telfer,et al.  Energy functions for minimizing misclassification error with minimum-complexity networks , 1994, Neural Networks.

[7]  Xiao Liu,et al.  Conditional distribution learning with neural networks and its application to channel equalization , 1997, IEEE Trans. Signal Process..

[8]  Geoffrey E. Hinton,et al.  A soft decision-directed LMS algorithm for blind equalization , 1993, IEEE Trans. Commun..

[9]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[10]  Ezio Biglieri,et al.  Analysis and compensation of nonlinearities in digital transmission systems , 1988, IEEE J. Sel. Areas Commun..

[11]  Alan Hutchinson,et al.  Algorithmic Learning , 1994 .

[12]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[13]  S. Pupolin,et al.  Nonlinearity compensation in digital radio systems , 1994, IEEE Trans. Commun..

[14]  Bruce W. Suter,et al.  The multilayer perceptron as an approximation to a Bayes optimal discriminant function , 1990, IEEE Trans. Neural Networks.

[15]  Shun-ichi Amari,et al.  Backpropagation and stochastic gradient descent method , 1993, Neurocomputing.

[16]  Jesús Cid-Sueiro,et al.  Digital Equalization Using Modular Neural Networks: an Overview , 1996 .

[17]  Sheng Chen,et al.  Reconstruction of binary signals using an adaptive radial-basis-function equalizer , 1991, Signal Process..

[18]  Yaser S. Abu-Mostafa,et al.  Hints , 2018, Neural Computation.

[19]  Geoffrey E. Hinton Connectionist Learning Procedures , 1989, Artif. Intell..