A Novel Deep Neural Network Based Approach for Sparse Code Multiple Access

Sparse code multiple access (SCMA) has been one of non-orthogonal multiple access (NOMA) schemes aiming to support high spectral efficiency and ubiquitous access requirements for 5G wireless communication networks. Conventional SCMA approaches are confronting remarkable challenges in designing low complexity high accuracy decoding algorithm and constructing optimum codebooks. Fortunately, the recent spotlighted deep learning technologies are of significant potentials in solving many communication engineering problems. Inspired by this, we explore approaches to improve SCMA performances with the help of deep learning methods. We propose and train a deep neural network (DNN) called DL-SCMA to learn to decode SCMA modulated signals corrupted by additive white Gaussian noise (AWGN). Putting encoding and decoding together, an autoencoder called AE-SCMA is established and trained to generate optimal SCMA codewords and reconstruct original bits. Furthermore, by manipulating the mapping vectors, an autoencoder is able to generalize SCMA, thus a dense code multiple access (DCMA) scheme is proposed. Simulations show that the DNN SCMA decoder significantly outperforms the conventional message passing algorithm (MPA) in terms of bit error rate (BER), symbol error rate (SER) and computational complexity, and AE-SCMA also demonstrates better performances via constructing better SCMA codebooks. The performance of deep learning aided DCMA is superior to the SCMA.

[1]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[2]  Zhongliang Zhu,et al.  Spherical Codes for SCMA Codebook , 2016, 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring).

[3]  Nam-I Kim,et al.  Deep Learning-Aided SCMA , 2018, IEEE Communications Letters.

[4]  Danilo Silva,et al.  A Multistage Method for SCMA Codebook Design Based on MDS Codes , 2019, IEEE Wireless Communications Letters.

[5]  Lei Wen,et al.  Design of SCMA Codebooks Based on Golden Angle Modulation , 2019, IEEE Transactions on Vehicular Technology.

[6]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[7]  Woongsup Lee,et al.  A Novel PAPR Reduction Scheme for OFDM System Based on Deep Learning , 2018, IEEE Communications Letters.

[8]  Reza Hoshyar,et al.  Novel Low-Density Signature for Synchronous CDMA Systems Over AWGN Channel , 2008, IEEE Transactions on Signal Processing.

[9]  Richard P. Brent,et al.  Modern Computer Arithmetic , 2010 .

[10]  Jingjing Wu,et al.  The Low Complexity Multi-user Detection Algorithms for Uplink SCMA System , 2019, WISATS.

[11]  Minjian Zhao,et al.  A low complexity detector for downlink SCMA systems , 2017, IET Commun..

[12]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[13]  Jiaru Lin,et al.  Improved Message Passing Algorithms for Sparse Code Multiple Access , 2017, IEEE Transactions on Vehicular Technology.

[14]  Jing Wang,et al.  Optimized SCMA Codebook Design by QAM Constellation Segmentation With Maximized MED , 2018, IEEE Access.

[15]  Jiaru Lin,et al.  An Efficient SCMA Codebook Optimization Algorithm Based on Mutual Information Maximization , 2018, Wirel. Commun. Mob. Comput..

[16]  Jianyue Zhu,et al.  Optimal Power Allocation for Downlink NOMA Systems , 2019 .

[17]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Dageng Chen,et al.  Multi-Dimensional SCMA Codebook Design Based on Constellation Rotation and Interleaving , 2016, 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring).

[19]  Nicolas Sendrier,et al.  Worst case QC-MDPC decoder for McEliece cryptosystem , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[20]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[21]  Yair Be'ery,et al.  Improved random redundant iterative HDPC decoding , 2009, IEEE Transactions on Communications.

[22]  Cheng Li,et al.  SCMA codebook design based on constellation rotation , 2017, 2017 IEEE International Conference on Communications (ICC).

[23]  Inkyu Lee,et al.  Deep learning based transceiver design for multi-colored VLC systems. , 2018, Optics express.

[24]  Alireza Bayesteh,et al.  SCMA Codebook Design , 2014, 2014 IEEE 80th Vehicular Technology Conference (VTC2014-Fall).

[25]  Timothy J. O'Shea,et al.  Deep Learning Based MIMO Communications , 2017, ArXiv.

[26]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[27]  Halim Yanikomeroglu,et al.  Enabling Sphere Decoding for SCMA , 2017, IEEE Communications Letters.

[28]  Lin Yang,et al.  Low Complexity Message Passing Algorithm for SCMA System , 2016, IEEE Communications Letters.

[29]  Timothy J. O'Shea,et al.  Deep architectures for modulation recognition , 2017, 2017 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[30]  Jeffrey G. Andrews,et al.  One-Bit OFDM Receivers via Deep Learning , 2018, IEEE Transactions on Communications.

[31]  Xizhao Wang,et al.  A review on neural networks with random weights , 2018, Neurocomputing.

[32]  Jianhao Hu,et al.  A Joint Update Parallel MCMC-Method-Based Sparse Code Multiple Access Decoder , 2018, IEEE Transactions on Vehicular Technology.

[33]  Yik-Chung Wu,et al.  Non-Orthogonal Opportunistic Beamforming: Performance Analysis and Implementation , 2012, IEEE Transactions on Wireless Communications.

[34]  Pingzhi Fan,et al.  Design and Analysis of SCMA Codebook Based on Star-QAM Signaling Constellations , 2018, IEEE Transactions on Vehicular Technology.

[35]  Stephan ten Brink,et al.  On deep learning-based channel decoding , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[36]  Guan Gui,et al.  Deep Learning for Super-Resolution Channel Estimation and DOA Estimation Based Massive MIMO System , 2018, IEEE Transactions on Vehicular Technology.

[37]  Zhengang Pan,et al.  Software defined air interface: a framework of 5G air interface , 2015, 2015 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[38]  Li Ping,et al.  On interleave-division multiple-access , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[39]  Biing-Hwang Juang,et al.  Deep Learning in Physical Layer Communications , 2018, IEEE Wireless Communications.

[40]  Uwe Meier,et al.  Wireless interference identification with convolutional neural networks , 2017, 2017 IEEE 15th International Conference on Industrial Informatics (INDIN).

[41]  Pingzhi Fan,et al.  An optimized design of SCMA codebook based on star-QAM signaling constellations , 2015, 2015 International Conference on Wireless Communications & Signal Processing (WCSP).

[42]  Stephan ten Brink,et al.  OFDM-Autoencoder for End-to-End Learning of Communications Systems , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[43]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[44]  David Burshtein,et al.  Deep Learning Methods for Improved Decoding of Linear Codes , 2017, IEEE Journal of Selected Topics in Signal Processing.

[45]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[46]  Vimal Bhatia,et al.  SCMA Codebook Based on Optimization of Mutual Information and Shaping Gain , 2018, 2018 IEEE Globecom Workshops (GC Wkshps).

[47]  Zhifeng Yuan,et al.  Multi-User Shared Access for Internet of Things , 2016, 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring).

[48]  Shuangfeng Han,et al.  Non-orthogonal multiple access for 5G: solutions, challenges, opportunities, and future research trends , 2015, IEEE Communications Magazine.

[49]  Min Jia,et al.  A Low Complexity Detection Algorithm for Fixed Up-Link SCMA System in Mission Critical Scenario , 2018, IEEE Internet of Things Journal.

[50]  V. P. Klimentyev,et al.  SCMA Codebooks Optimization Based on Genetic Algorithm , 2017 .

[51]  Giuseppe Aceto,et al.  Mobile Encrypted Traffic Classification Using Deep Learning: Experimental Evaluation, Lessons Learned, and Challenges , 2019, IEEE Transactions on Network and Service Management.

[52]  Yair Be'ery,et al.  Learning to decode linear codes using deep learning , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[53]  Shaodan Ma,et al.  On Capacity-Based Codebook Design and Advanced Decoding for Sparse Code Multiple Access Systems , 2018, IEEE Transactions on Wireless Communications.

[54]  Polina Bayvel,et al.  End-to-End Deep Learning of Optical Fiber Communications , 2018, Journal of Lightwave Technology.

[55]  Jiaru Lin,et al.  An Efficient SCMA Codebook Design Based on 1-D Searching Algorithm , 2018, IEEE Communications Letters.

[56]  Fumiyuki Adachi,et al.  Deep-Learning-Based Millimeter-Wave Massive MIMO for Hybrid Precoding , 2019, IEEE Transactions on Vehicular Technology.

[57]  Alireza Bayesteh,et al.  Low Complexity Techniques for SCMA Detection , 2015, 2015 IEEE Globecom Workshops (GC Wkshps).

[58]  Yan Liu,et al.  Low-dose CT restoration via stacked sparse denoising autoencoders , 2018, Neurocomputing.

[59]  Nikos D. Sidiropoulos,et al.  Learning to optimize: Training deep neural networks for wireless resource management , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[60]  Anass Benjebbour,et al.  Non-Orthogonal Multiple Access (NOMA) for Cellular Future Radio Access , 2013, 2013 IEEE 77th Vehicular Technology Conference (VTC Spring).

[61]  Jianhao Hu,et al.  Sparse Code Multiple Access Decoding Based on a Monte Carlo Markov Chain Method , 2016, IEEE Signal Processing Letters.

[62]  Antonio Pescapè,et al.  Know your Big Data Trade-offs when Classifying Encrypted Mobile Traffic with Deep Learning , 2019, 2019 Network Traffic Measurement and Analysis Conference (TMA).

[63]  Chen Sun,et al.  Joint Optimization of Constellation With Mapping Matrix for SCMA Codebook Design , 2017, IEEE Signal Processing Letters.

[64]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[65]  Hosein Nikopour,et al.  Sparse code multiple access , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[66]  Shunming Li,et al.  Batch-normalized deep neural networks for achieving fast intelligent fault diagnosis of machines , 2019, Neurocomputing.

[67]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[68]  Cong Shen,et al.  An Iterative BP-CNN Architecture for Channel Decoding , 2017, IEEE Journal of Selected Topics in Signal Processing.

[69]  Tao Jiang,et al.  Deep learning for wireless physical layer: Opportunities and challenges , 2017, China Communications.

[70]  Kewu Peng,et al.  Scalable Video Broadcasting Using Bit Division Multiplexing , 2014, IEEE Transactions on Broadcasting.

[71]  Kai Niu,et al.  Pattern Division Multiple Access—A Novel Nonorthogonal Multiple Access for Fifth-Generation Radio Networks , 2017, IEEE Transactions on Vehicular Technology.