On Sphere Detection and Minimum-Phase Prefiltered Reduced-State Sequence Estimation

In this paper, prefiltering techniques for sphere detection (SD) in frequency-selective channels are examined. It is shown that a link between QL-factorization of the channel matrix and minimum-phase prefiltering exists. As a result, it is possible to regard SD as a generalization of traditional reduced- state sequence estimation, providing a unifying framework for the two detection methods. It is illustrated how minimum-phase prefiltering or the linear minimum mean-square error decision feedback equalization (LMMSE-DFE) forward filter is capable of reducing the complexity of sphere detectors significantly, while still obtaining near-optimal performance. The significant reduction in complexity is obtained as prefiltering enables earlier decision making in SD. Simulations carried out in an EDGE system confirm that prefiltering leads to a considerable complexity reduction for sphere detectors.

[1]  Giuseppe Caire,et al.  On maximum-likelihood detection and the search for the closest lattice point , 2003, IEEE Trans. Inf. Theory.

[2]  Ali H. Sayed,et al.  A survey of spectral factorization methods , 2001, Numer. Linear Algebra Appl..

[3]  Babak Hassibi,et al.  On the sphere-decoding algorithm I. Expected complexity , 2005, IEEE Transactions on Signal Processing.

[4]  Robert Schober,et al.  Equalization concepts for EDGE , 2002, IEEE Trans. Wirel. Commun..

[5]  John M. Cioffi,et al.  MMSE decision-feedback equalizers: finite-length results , 1995, IEEE Trans. Inf. Theory.

[6]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[7]  Shahid U. H. Qureshi,et al.  Reduced-state sequence estimation with set partitioning and decision feedback , 1988, IEEE Trans. Commun..

[8]  M. O. Damen,et al.  A unified framework for tree search decoding: rediscovering the sequential decoder , 2005, SPAWC 2005.

[9]  Björn E. Ottersten,et al.  On the complexity of sphere decoding in digital communications , 2005, IEEE Transactions on Signal Processing.

[10]  Urbashi Mitra,et al.  Sphere-constrained ML detection for frequency-selective channels , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  Claus-Peter Schnorr,et al.  Lattice Basis Reduction: Improved Practical Algorithms and Solving Subset Sum Problems , 1991, FCT.

[12]  Babak Hassibi,et al.  Statistical Pruning for Near-Maximum Likelihood Decoding , 2007, IEEE Transactions on Signal Processing.

[13]  Urbashi Mitra,et al.  Sphere-constrained ML detection for frequency-selective channels , 2006, IEEE Transactions on Communications.