Channel Estimation via Successive Denoising in MIMO OFDM Systems: A Reinforcement Learning Approach

In general, reliable communication via multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) requires accurate channel estimation at the receiver. The existing literature largely focuses on denoising methods for channel estimation that depend on either (i) channel analysis in the time-domain with prior channel knowledge or (ii) supervised learning techniques which require large prelabeled datasets for training. To address these limitations, we present a frequency-domain denoising method based on a reinforcement learning framework that does not need a priori channel knowledge and pre-labeled data. Our methodology includes a new successive channel denoising process based on channel curvature computation, for which we obtain a channel curvature magnitude threshold to identify unreliable channel estimates. Based on this process, we formulate the denoising mechanism as a Markov decision process, where we define the actions through a geometry-based channel estimation update, and the reward function based on a policy that reduces mean squared error (MSE). We then resort to Q-learning to update the channel estimates. Numerical results verify that our denoising algorithm can successfully mitigate noise in channel estimates. In particular, our algorithm provides a significant improvement over the practical least squares (LS) estimation method and provides performance that approaches that of the ideal linear minimum mean square error (LMMSE) estimation with perfect knowledge of channel statistics.

[1]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[2]  P. Alam ‘G’ , 2021, Composites Engineering: An A–Z Guide.

[3]  Hui Xie,et al.  Efficient time domain threshold for sparse channel estimation in OFDM system , 2014 .

[4]  장윤희,et al.  Y. , 2003, Industrial and Labor Relations Terms.

[5]  Geoffrey Ye Li,et al.  Channel Estimation for OFDM , 2014, IEEE Communications Surveys & Tutorials.

[6]  P. Sadeghi,et al.  Finite-state Markov modeling of fading channels - a survey of principles and applications , 2008, IEEE Signal Processing Magazine.

[7]  P. Alam ‘Z’ , 2021, Composites Engineering: An A–Z Guide.

[8]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.

[9]  Zhiliang Qiu,et al.  Novel noise reduction algorithm for LS channel estimation in OFDM system with frequency selective channels , 2010, 2010 IEEE International Conference on Communication Systems.

[10]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[11]  V. K. Jones,et al.  Channel estimation for wireless OFDM systems , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[12]  Rodney A. Kennedy,et al.  Finite-State Markov Modeling of Fading Channels , 2022 .

[13]  Giovanni Emanuele Corazza,et al.  OFDM Channel Estimation Based on Impulse Response Decimation: Analysis and Novel Algorithms , 2012, IEEE Transactions on Communications.

[14]  Hao Chen,et al.  Deep Residual Learning Meets OFDM Channel Estimation , 2020, IEEE Wireless Communications Letters.

[15]  P. Moran,et al.  Mathematics of Statistics , 1948, Nature.

[16]  Thomas de Quincey [C] , 2000, The Works of Thomas De Quincey, Vol. 1: Writings, 1799–1820.

[17]  Hamid Sheikhzadeh,et al.  Deep Learning-Based Channel Estimation , 2018, IEEE Communications Letters.

[18]  Zhezhuang Xu,et al.  A new channel estimation method based on GPR and wavelet denosing , 2019, 2019 3rd International Symposium on Autonomous Systems (ISAS).

[19]  P. Alam ‘L’ , 2021, Composites Engineering: An A–Z Guide.