Support vector machine techniques for nonlinear equalization

The emerging machine learning technique called support vector machines is proposed as a method for performing nonlinear equalization in communication systems. The support vector machine has the advantage that a smaller number of parameters for the model can be identified in a manner that does not require the extent of prior information or heuristic assumptions that some previous techniques require. Furthermore, the optimization method of a support vector machine is quadratic programming, which is a well-studied and understood mathematical programming technique. Support vector machine simulations are carried out on nonlinear problems previously studied by other researchers using neural networks. This allows initial comparison against other techniques to determine the feasibility of using the proposed method for nonlinear detection. Results show that support vector machines perform as well as neural networks on the nonlinear problems investigated. A method is then proposed to introduce decision feedback processing to support vector machines to address the fact that intersymbol interference (ISI) data generates input vectors having temporal correlation, whereas a standard support vector machine assumes independent input vectors. Presenting the problem from the viewpoint of the pattern space illustrates the utility of a bank of support vector machines. This approach yields a nonlinear processing method that is somewhat different than the nonlinear decision feedback method whereby the linear feedback filter of the decision feedback equalizer is replaced by a Volterra filter. A simulation using a linear system shows that the proposed method performs equally to a conventional decision feedback equalizer for this problem.

[1]  David R. Musicant,et al.  Data Discrimination via Nonlinear Generalized Support Vector Machines , 2001 .

[2]  Allen Gersho,et al.  Adaptive Cancellation of Nonlinear Intersymbol Interference for Voiceband Data Transmission , 1984, IEEE Journal on Selected Areas in Communications.

[3]  D. P. Taylor,et al.  On the application of feed forward neural networks to channel equalization , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[4]  C.F.N. Cowan,et al.  The application of nonlinear structures to the reconstruction of binary signals , 1991, IEEE Trans. Signal Process..

[5]  G. Sicuranza,et al.  V-vector algebra and its application to Volterra-adaptive filtering , 1999 .

[6]  Henry Stark,et al.  Probability, Random Processes, and Estimation Theory for Engineers , 1995 .

[7]  D. Falconer Adaptive equalization of channel nonlinearities in QAM data transmission systems , 1978, The Bell System Technical Journal.

[8]  C.F.N. Cowan,et al.  Adaptive equalization of finite nonlinear channels using multilayer perceptron , 1990 .

[9]  Thorsten Joachims,et al.  Making large-scale support vector machine learning practical , 1999 .

[10]  Linda Kaufman,et al.  Solving the quadratic programming problem arising in support vector classification , 1999 .

[11]  S. Personick Receiver design for digital fiber optic communication systems, II , 1973 .

[12]  Bhaskar D. Rao,et al.  Fast adaptive digital equalization by recurrent neural networks , 1997, IEEE Trans. Signal Process..

[13]  Robert Haber Nonlinear System Identification : Input-output Modeling Approach , 1999 .

[14]  Sheng Chen,et al.  Adaptive Equalisation to finite Non-linear Channels using Multilayer Perceptrons , 1990 .

[15]  Sergio Benedetto,et al.  Digital Transmission Theory , 1987 .

[16]  Robert D. Nowak,et al.  Tensor product basis approximations for Volterra filters , 1996, IEEE Trans. Signal Process..

[17]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[18]  Mansoor Shafi,et al.  Quick Simulation: A Review of Importance Sampling Techniques in Communications Systems , 1997, IEEE J. Sel. Areas Commun..

[19]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[20]  Federico Girosi,et al.  Reducing the run-time complexity of Support Vector Machines , 1999 .

[22]  Paolo Campolucci,et al.  Complex-valued neural networks with adaptive spline activation function for digital-radio-links nonlinear equalization , 1999, IEEE Trans. Signal Process..

[23]  Elias S. Manolakos,et al.  Using recurrent neural networks for adaptive communication channel equalization , 1994, IEEE Trans. Neural Networks.

[24]  Michael C. Ferris,et al.  Interfaces to PATH 3.0: Design, Implementation and Usage , 1999, Comput. Optim. Appl..

[25]  Grace Wahba,et al.  Generalized Approximate Cross Validation For Support Vector Machines, Or, Another Way To Look At Mar , 1999 .

[26]  Aníbal R. Figueiras-Vidal,et al.  Sample selection via clustering to construct support vector-like classifiers , 1999, IEEE Trans. Neural Networks.

[27]  Robert D. Nowak,et al.  Volterra filter equalization: a fixed point approach , 1997, IEEE Trans. Signal Process..

[28]  F. Wallace FIBER OPTICS. , 1965, Hospital topics.

[29]  中澤 真,et al.  Devroye, L., Gyorfi, L. and Lugosi, G. : A Probabilistic Theory of Pattern Recognition, Springer (1996). , 1997 .

[30]  Michel C. Jeruchim,et al.  Developments in the Theory and Application of Importance Sampling , 1987, IEEE Trans. Commun..

[31]  Sheng Chen,et al.  Adaptive Bayesian equalizer with decision feedback , 1993, IEEE Trans. Signal Process..

[32]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[33]  Govind P. Agrawal,et al.  Nonlinear Fiber Optics , 1989 .

[34]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.