Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues

As a key technique for enabling artificial intelligence, machine learning (ML) is capable of solving complex problems without explicit programming. Motivated by its successful applications to many practical tasks like image recognition, both industry and the research community have advocated the applications of ML in wireless communication. This paper comprehensively surveys the recent advances of the applications of ML in wireless communication, which are classified as: resource management in the MAC layer, networking and mobility management in the network layer, and localization in the application layer. The applications in resource management further include power control, spectrum management, backhaul management, cache management, and beamformer design and computation resource management, while ML-based networking focuses on the applications in clustering, base station switching control, user association, and routing. Moreover, literatures in each aspect is organized according to the adopted ML techniques. In addition, several conditions for applying ML to wireless communication are identified to help readers decide whether to use ML and which kind of ML techniques to use. Traditional approaches are also summarized together with their performance comparison with ML-based approaches, based on which the motivations of surveyed literatures to adopt ML are clarified. Given the extensiveness of the research area, challenges and unresolved issues are presented to facilitate future studies. Specifically, ML-based network slicing, infrastructure update to support ML-based paradigms, open data sets and platforms for researchers, theoretical guidance for ML implementation, and so on are discussed.

[1]  Walid Saad,et al.  Echo State Networks for Self-Organizing Resource Allocation in LTE-U With Uplink–Downlink Decoupling , 2016, IEEE Transactions on Wireless Communications.

[2]  Mugen Peng,et al.  Deep Reinforcement Learning-Based Mode Selection and Resource Management for Green Fog Radio Access Networks , 2018, IEEE Internet of Things Journal.

[3]  Tommi S. Jaakkola,et al.  Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms , 2000, Machine Learning.

[4]  Kaishun Wu,et al.  FIFS: Fine-Grained Indoor Fingerprinting System , 2012, 2012 21st International Conference on Computer Communications and Networks (ICCCN).

[5]  Muhammad Ali Imran,et al.  Fuzzy Q-learning-based user-centric backhaul-aware user cell association scheme , 2017, 2017 13th International Wireless Communications and Mobile Computing Conference (IWCMC).

[6]  Yoshikazu Miyanaga,et al.  An Autonomous Learning-Based Algorithm for Joint Channel and Power Level Selection by D2D Pairs in Heterogeneous Cellular Networks , 2016, IEEE Transactions on Communications.

[7]  Xianfu Chen,et al.  TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access Networks , 2012, IEEE Transactions on Wireless Communications.

[8]  Muhammad Ali Imran,et al.  A Multiple Attribute User-Centric Backhaul Provisioning Scheme Using Distributed SON , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[9]  Walid Saad,et al.  Virtual Reality Over Wireless Networks: Quality-of-Service Model and Learning-Based Resource Management , 2017, IEEE Transactions on Communications.

[10]  Marco Miozzo,et al.  Distributed Q-learning for energy harvesting Heterogeneous Networks , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[11]  Soung Chang Liew,et al.  Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks , 2019, IEEE J. Sel. Areas Commun..

[12]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[13]  Shiwen Mao,et al.  CSI Phase Fingerprinting for Indoor Localization With a Deep Learning Approach , 2016, IEEE Internet of Things Journal.

[14]  Hai Jin,et al.  Modeling User Activity Patterns for Next-Place Prediction , 2017, IEEE Systems Journal.

[15]  Ohtsuki Tomoaki,et al.  Cell Range Expansion Using Distributed Q-Learning in Heterogeneous Networks , 2012 .

[16]  Leandros Tassiulas,et al.  Mobile Data Offloading for Green Wireless Networks , 2017, IEEE Wireless Communications.

[17]  Mehdi Bennis,et al.  Anticipatory Caching in Small Cell Networks: A Transfer Learning Approach , 2014 .

[18]  Gang Cao,et al.  AIF: An Artificial Intelligence Framework for Smart Wireless Network Management , 2018, IEEE Communications Letters.

[19]  Xuelong Li,et al.  Recent Advances in Cloud Radio Access Networks: System Architectures, Key Techniques, and Open Issues , 2016, IEEE Communications Surveys & Tutorials.

[20]  Edward A. Fox,et al.  Caching Proxies: Limitations and Potentials , 1995, WWW.

[21]  Ingrid Moerman,et al.  Handover Parameter Optimization in LTE Self-Organizing Networks , 2010, 2010 IEEE 72nd Vehicular Technology Conference - Fall.

[22]  Navrati Saxena,et al.  Next Generation 5G Wireless Networks: A Comprehensive Survey , 2016, IEEE Communications Surveys & Tutorials.

[23]  Walid Saad,et al.  Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural Networks , 2017, ArXiv.

[24]  Liu Haitao,et al.  Energy efficient switch policy for small cells , 2015, China Communications.

[25]  Hwee Pink Tan,et al.  Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications , 2014, IEEE Communications Surveys & Tutorials.

[26]  Anand Srivastava,et al.  Energy saving in heterogeneous cellular network via transfer reinforcement learning based policy , 2017, 2017 9th International Conference on Communication Systems and Networks (COMSNETS).

[27]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[28]  Mugen Peng,et al.  Fog-computing-based radio access networks: issues and challenges , 2015, IEEE Network.

[29]  Nei Kato,et al.  State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems , 2017, IEEE Communications Surveys & Tutorials.

[30]  Erdogan Dogdu,et al.  Context-Aware Computing, Learning, and Big Data in Internet of Things: A Survey , 2018, IEEE Internet of Things Journal.

[31]  Moe Z. Win,et al.  A Machine Learning Approach to Ranging Error Mitigation for UWB Localization , 2012, IEEE Transactions on Communications.

[32]  Jitendra K. Tugnait,et al.  TCP-Drinc: Smart Congestion Control Based on Deep Reinforcement Learning , 2019, IEEE Access.

[33]  Wei Wang,et al.  Edge Caching at Base Stations With Device-to-Device Offloading , 2017, IEEE Access.

[34]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[35]  Wei-Ping Zhu,et al.  Joint Beamforming and Power Control for Device-to-Device Communications Underlaying Cellular Networks , 2016, IEEE Journal on Selected Areas in Communications.

[36]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[37]  Miao Pan,et al.  Deep ${Q}$ -Network-Based Route Scheduling for TNC Vehicles With Passengers’ Location Differential Privacy , 2019, IEEE Internet of Things Journal.

[38]  Arumugam Nallanathan,et al.  Energy-Efficient Chance-Constrained Resource Allocation for Multicast Cognitive OFDM Network , 2016, IEEE Journal on Selected Areas in Communications.

[39]  Federico Boccardi,et al.  SLEEP mode techniques for small cell deployments , 2011, IEEE Communications Magazine.

[40]  Nan Zhao,et al.  Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach , 2018, IEEE Transactions on Vehicular Technology.

[41]  Xianfu Chen,et al.  Energy saving through a learning framework in greener cellular radio access networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[42]  Guanding Yu,et al.  Dual-threshold sleep mode control scheme for small cells , 2014, IET Commun..

[43]  Xiaofei Wang,et al.  Cache in the air: exploiting content caching and delivery techniques for 5G systems , 2014, IEEE Communications Magazine.

[44]  Zhu Han,et al.  A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks , 2015, IEEE Communications Surveys & Tutorials.

[45]  P. Y. Glorennec,et al.  Fuzzy Q-learning and dynamical fuzzy Q-learning , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[46]  Zhu Han,et al.  Self-Organization in Small Cell Networks: A Reinforcement Learning Approach , 2013, IEEE Transactions on Wireless Communications.

[47]  Yong Li,et al.  System architecture and key technologies for 5G heterogeneous cloud radio access networks , 2015, IEEE Netw..

[48]  H. Abdi,et al.  Principal component analysis , 2010 .

[49]  Ekram Hossain,et al.  Deep Learning for Radio Resource Allocation in Multi-Cell Networks , 2018, IEEE Network.

[50]  Hyundong Shin,et al.  Machine Learning for Wideband Localization , 2015, IEEE Journal on Selected Areas in Communications.

[51]  Setareh Maghsudi,et al.  Distributed User Association in Energy Harvesting Dense Small Cell Networks: A Mean-Field Multi-Armed Bandit Approach , 2016, IEEE Access.

[52]  Slawomir Kuklinski,et al.  Joint implementation of several LTE-SON functions , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[53]  Moustafa Youssef,et al.  The Horus WLAN location determination system , 2005, MobiSys '05.

[54]  Matti Latva-aho,et al.  Dynamic Clustering and on/off Strategies for Wireless Small Cell Networks , 2015, IEEE Transactions on Wireless Communications.

[55]  Sudharman K. Jayaweera,et al.  A Survey on Machine-Learning Techniques in Cognitive Radios , 2013, IEEE Communications Surveys & Tutorials.

[56]  Dorin Panaitopol,et al.  Reinforcement learning approach to dynamic activation of base station resources in wireless networks , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[57]  Jeffrey G. Andrews,et al.  User Association for Load Balancing in Heterogeneous Cellular Networks , 2012, IEEE Transactions on Wireless Communications.

[58]  David Grace,et al.  Cognitive green backhaul deployments for future 5G networks , 2014, 2014 1st International Workshop on Cognitive Cellular Systems (CCS).

[59]  Matti Latva-aho,et al.  Learning-Based Caching in Cloud-Aided Wireless Networks , 2018, IEEE Communications Letters.

[60]  Mehdi Bennis,et al.  Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[61]  Jing Liu,et al.  Dynamic fuzzy Q-learning for handover parameters optimization in 5G multi-tier networks , 2015, 2015 International Conference on Wireless Communications & Signal Processing (WCSP).

[62]  Hui Tian,et al.  Self-optimized heterogeneous networks for energy efficiency , 2015, EURASIP J. Wirel. Commun. Netw..

[63]  黃崇冀,et al.  Machine learning : an artificial intelligence approach , 1988 .

[64]  Mustafa Cenk Gursoy,et al.  A deep reinforcement learning-based framework for content caching , 2017, 2018 52nd Annual Conference on Information Sciences and Systems (CISS).

[65]  Rashid Rashidzadeh,et al.  A Fast and Resource Efficient Method for Indoor Positioning Using Received Signal Strength , 2016, IEEE Transactions on Vehicular Technology.

[66]  Xuefeng Yin,et al.  Neural-Network-Assisted UE Localization Using Radio-Channel Fingerprints in LTE Networks , 2017, IEEE Access.

[67]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[68]  Shiwen Mao,et al.  PhaseFi: Phase Fingerprinting for Indoor Localization with a Deep Learning Approach , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[69]  Raman Paranjape,et al.  Classification of User Trajectories in LTE HetNets Using Unsupervised Shapelets and Multiresolution Wavelet Decomposition , 2017, IEEE Transactions on Vehicular Technology.

[70]  Mehdi Bennis,et al.  A transfer learning approach for cache-enabled wireless networks , 2015, 2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[71]  John M. Cioffi,et al.  CaSRA: An algorithm for cognitive tethering in dense wireless areas , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[72]  Yi Zhang,et al.  Learning Temporal–Spatial Spectrum Reuse , 2016, IEEE Transactions on Communications.

[73]  Wenbo Wang,et al.  TD-SCDMA Evolution , 2010, IEEE Vehicular Technology Magazine.

[74]  Muhammad Ali Imran,et al.  An adaptive backhaul-aware cell range extension approach , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[75]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[76]  Bhaskar Krishnamachari,et al.  Base Station Operation and User Association Mechanisms for Energy-Delay Tradeoffs in Green Cellular Networks , 2011, IEEE Journal on Selected Areas in Communications.

[77]  Klaus Moessner,et al.  Dynamic Heterogeneous Learning Games for Opportunistic Access in LTE-Based Macro/Femtocell Deployments , 2015, IEEE Transactions on Wireless Communications.

[78]  Lin Dai,et al.  Low-Complexity Beam Allocation for Switched-Beam Based Multiuser Massive MIMO Systems , 2016, IEEE Transactions on Wireless Communications.

[79]  Qi Hao,et al.  Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.

[80]  Nei Kato,et al.  The Deep Learning Vision for Heterogeneous Network Traffic Control: Proposal, Challenges, and Future Perspective , 2017, IEEE Wireless Communications.

[81]  Walid Saad,et al.  Learning How to Communicate in the Internet of Things: Finite Resources and Heterogeneity , 2016, IEEE Access.

[82]  Kaijie Zhou,et al.  Robust Cross-Layer Design with Reinforcement Learning for IEEE 802.11n Link Adaptation , 2011, 2011 IEEE International Conference on Communications (ICC).

[83]  Jiang Hao,et al.  Consensus-Based Parallel Extreme Learning Machine for Indoor Localization , 2016 .

[84]  Matti Latva-aho,et al.  Backhaul-Aware Interference Management in the Uplink of Wireless Small Cell Networks , 2013, IEEE Transactions on Wireless Communications.

[85]  Kamran Arshad,et al.  Dynamic Spectrum Allocation Algorithm with Interference Management in Co-Existing Networks , 2011, IEEE Communications Letters.

[86]  Jiang Xu,et al.  Multi-layer neural network for received signal strength-based indoor localisation , 2016, IET Commun..

[87]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[88]  Zhong Fan,et al.  Emerging technologies and research challenges for 5G wireless networks , 2014, IEEE Wireless Communications.

[89]  Mugen Peng,et al.  Economical Energy Efficiency: An Advanced Performance Metric for 5G Systems , 2017, IEEE Wireless Communications.

[90]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[91]  Gunther Auer,et al.  Distributed Learning in Multiuser OFDMA Femtocell Networks , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[92]  H. Vincent Poor,et al.  Fronthaul-constrained cloud radio access networks: insights and challenges , 2015, IEEE Wireless Communications.

[93]  Yu Cheng,et al.  Towards Energy-Efficient Wireless Networking in the Big Data Era: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[94]  Nei Kato,et al.  On Removing Routing Protocol from Future Wireless Networks: A Real-time Deep Learning Approach for Intelligent Traffic Control , 2018, IEEE Wireless Communications.

[95]  Xiaofei Wang,et al.  Artificial Intelligence-Based Techniques for Emerging Heterogeneous Network: State of the Arts, Opportunities, and Challenges , 2015, IEEE Access.

[96]  Xianfu Chen,et al.  Deep Reinforcement Learning for Resource Management in Network Slicing , 2018, IEEE Access.

[97]  Wahidah Hashim,et al.  Effects of network characteristics on learning mechanism for routing in cognitive radio ad hoc networks , 2014, 2014 9th International Symposium on Communication Systems, Networks & Digital Sign (CSNDSP).

[98]  Yang Xu,et al.  Adaptive biasing scheme for load balancing in backhaul constrained small cell networks , 2015, IET Commun..

[99]  Lin Ma,et al.  Optimal KNN Positioning Algorithm via Theoretical Accuracy Criterion in WLAN Indoor Environment , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[100]  Honggang Zhang,et al.  A transfer learning framework for energy efficient Wi-Fi networks and performance analysis using real data , 2016, 2016 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS).

[101]  Ismail Güvenç,et al.  Learning Based Frequency- and Time-Domain Inter-Cell Interference Coordination in HetNets , 2014, IEEE Transactions on Vehicular Technology.

[102]  Nan Zhao,et al.  Adaptive Power Allocation Schemes for Spectrum Sharing in Interference-Alignment-Based Cognitive Radio Networks , 2016, IEEE Transactions on Vehicular Technology.

[103]  Shiwen Mao,et al.  Dealing with Limited Backhaul Capacity in Millimeter-Wave Systems: A Deep Reinforcement Learning Approach , 2018, IEEE Communications Magazine.

[104]  Cheng Wang,et al.  User Association for Load Balancing in Vehicular Networks: An Online Reinforcement Learning Approach , 2017, IEEE Transactions on Intelligent Transportation Systems.

[105]  H. Vincent Poor,et al.  A Distributed Approach to Improving Spectral Efficiency in Uplink Device-to-Device-Enabled Cloud Radio Access Networks , 2018, IEEE Transactions on Communications.

[106]  Mubarak Shah,et al.  UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild , 2012, ArXiv.

[107]  Hyundong Shin,et al.  Content-Aware Proactive Caching for Backhaul Offloading in Cellular Network , 2018, IEEE Transactions on Wireless Communications.

[108]  Nei Kato,et al.  Device-to-Device Communication in LTE-Advanced Networks: A Survey , 2015, IEEE Communications Surveys & Tutorials.

[109]  S. Lasaulce,et al.  How can ignorant but patient cognitive terminals learn their strategy and utility? , 2010, 2010 IEEE 11th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[110]  Jing Wang,et al.  A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs , 2017, 2017 IEEE International Conference on Communications (ICC).

[111]  Mugen Peng,et al.  Network Slicing in Fog Radio Access Networks: Issues and Challenges , 2017, IEEE Communications Magazine.

[112]  Zhiguo Ding,et al.  Energy-Efficient Joint Congestion Control and Resource Optimization in Heterogeneous Cloud Radio Access Networks , 2016, IEEE Transactions on Vehicular Technology.

[113]  Bin Li,et al.  Learning-Based Spectrum Sharing and Spatial Reuse in mm-Wave Ultradense Networks , 2018, IEEE Transactions on Vehicular Technology.

[114]  Walid Saad,et al.  Cellular-Connected UAVs over 5G: Deep Reinforcement Learning for Interference Management , 2018, ArXiv.

[115]  Junyuan Wang,et al.  A Machine Learning Framework for Resource Allocation Assisted by Cloud Computing , 2017, IEEE Network.

[116]  Peter Stone,et al.  Transfer Learning for Reinforcement Learning Domains: A Survey , 2009, J. Mach. Learn. Res..

[117]  Kok-Lim Alvin Yau,et al.  Route Selection for Multi-Hop Cognitive Radio Networks Using Reinforcement Learning: An Experimental Study , 2016, IEEE Access.

[118]  Tao Jiang,et al.  Deep learning for wireless physical layer: Opportunities and challenges , 2017, China Communications.

[119]  Mugen Peng,et al.  Hierarchical Radio Resource Allocation for Network Slicing in Fog Radio Access Networks , 2019, IEEE Transactions on Vehicular Technology.

[120]  Shuguang Cui,et al.  Handover Control in Wireless Systems via Asynchronous Multiuser Deep Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[121]  Sen Wang,et al.  Big Data Enabled Mobile Network Design for 5G and Beyond , 2017, IEEE Communications Magazine.

[122]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[123]  Mehdi Bennis,et al.  Backhaul-aware self-organizing operator-shared small cell networks , 2013, 2013 IEEE International Conference on Communications (ICC).

[124]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[125]  Xianfu Chen,et al.  Deep Reinforcement Learning for Network Slicing , 2018, ArXiv.

[126]  Hans D. Schotten,et al.  Fuzzy Q-Learning for Mobility Robustness Optimization in wireless networks , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[127]  Frank Kelly,et al.  Charging and rate control for elastic traffic , 1997, Eur. Trans. Telecommun..

[128]  Yuxi Li,et al.  Deep Reinforcement Learning: An Overview , 2017, ArXiv.

[129]  Richard Demo Souza,et al.  A Survey of Machine Learning Techniques Applied to Self-Organizing Cellular Networks , 2017, IEEE Communications Surveys & Tutorials.

[130]  James Irvine,et al.  An Advanced SOM Algorithm Applied to Handover Management Within LTE , 2013, IEEE Transactions on Vehicular Technology.

[131]  Zhenzhong Chen,et al.  3-D BLE Indoor Localization Based on Denoising Autoencoder , 2017, IEEE Access.

[132]  Jiaheng Wang,et al.  Energy-Efficient Resource Assignment and Power Allocation in Heterogeneous Cloud Radio Access Networks , 2014, IEEE Transactions on Vehicular Technology.

[133]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[134]  Walid Saad,et al.  The 5G Cellular Backhaul Management Dilemma: To Cache or to Serve , 2017, IEEE Transactions on Wireless Communications.

[135]  Gul A. Agha,et al.  Space division and dimensional reduction methods for indoor positioning system , 2015, 2015 IEEE International Conference on Communications (ICC).

[136]  Ana Galindo-Serrano,et al.  Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[137]  Tapani Ristaniemi,et al.  Learn to Cache: Machine Learning for Network Edge Caching in the Big Data Era , 2018, IEEE Wireless Communications.

[138]  Zhu Han,et al.  User Association in Heterogeneous Networks: A Social Interaction Approach , 2016, IEEE Transactions on Vehicular Technology.

[139]  Yasir Saleem,et al.  Clustering and Reinforcement-Learning-Based Routing for Cognitive Radio Networks , 2017, IEEE Wireless Communications.

[140]  H. Vincent Poor,et al.  A Learning-Based Approach to Caching in Heterogenous Small Cell Networks , 2015, IEEE Transactions on Communications.

[141]  Ursula Challita,et al.  Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial , 2017, IEEE Communications Surveys & Tutorials.

[142]  Shiwen Mao,et al.  BiLoc: Bi-Modal Deep Learning for Indoor Localization With Commodity 5GHz WiFi , 2017, IEEE Access.

[143]  Victor C. M. Leung,et al.  Deep-Reinforcement-Learning-Based Optimization for Cache-Enabled Opportunistic Interference Alignment Wireless Networks , 2017, IEEE Transactions on Vehicular Technology.

[144]  Young-Bae Ko,et al.  QGeo: Q-Learning-Based Geographic Ad Hoc Routing Protocol for Unmanned Robotic Networks , 2017, IEEE Communications Letters.

[145]  David Grace,et al.  Using k-means clustering with transfer and Q learning for spectrum, load and energy optimization in opportunistic mobile broadband networks , 2015, 2015 International Symposium on Wireless Communication Systems (ISWCS).

[146]  Walid Saad,et al.  Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience , 2016, IEEE Journal on Selected Areas in Communications.

[147]  C. Siva Ram Murthy,et al.  A Q-Learning Framework for User QoE Enhanced Self-Organizing Spectrally Efficient Network Using a Novel Inter-Operator Proximal Spectrum Sharing , 2016, IEEE Journal on Selected Areas in Communications.

[148]  Mehdi Bennis,et al.  Multi-Tenant Cross-Slice Resource Orchestration: A Deep Reinforcement Learning Approach , 2018, IEEE Journal on Selected Areas in Communications.

[149]  Raquel Barco,et al.  Fuzzy Rule-Based Reinforcement Learning for Load Balancing Techniques in Enterprise LTE Femtocells , 2013, IEEE Transactions on Vehicular Technology.

[150]  Symeon Chatzinotas,et al.  A deep learning approach for optimizing content delivering in cache-enabled HetNet , 2017, 2017 International Symposium on Wireless Communication Systems (ISWCS).

[151]  Robert Babuska,et al.  A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[152]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[153]  S. N. Sivanandam,et al.  Genetic Algorithm Optimization Problems , 2008 .

[154]  Richard P. Wildes,et al.  Dynamic scene understanding: The role of orientation features in space and time in scene classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[155]  Sudarshan Guruacharya,et al.  Multi-Operator Spectrum Sharing for Small Cell Networks: A Matching Game Perspective , 2016, IEEE Transactions on Wireless Communications.

[156]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[157]  Zheng Yao,et al.  A Feature-Scaling-Based $k$-Nearest Neighbor Algorithm for Indoor Positioning Systems , 2014, IEEE Internet of Things Journal.

[158]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[159]  Lei Shu,et al.  ZIL: An Energy-Efficient Indoor Localization System Using ZigBee Radio to Detect WiFi Fingerprints , 2015, IEEE Journal on Selected Areas in Communications.

[160]  Martin F. Arlitt,et al.  Evaluating content management techniques for Web proxy caches , 2000, PERV.

[161]  Zhi-Quan Luo,et al.  An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[162]  Nikos D. Sidiropoulos,et al.  Learning to optimize: Training deep neural networks for wireless resource management , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[163]  Karl Henrik Johansson,et al.  Indoor Localization Without a Prior Map by Trajectory Learning From Crowdsourced Measurements , 2017, IEEE Transactions on Instrumentation and Measurement.

[164]  Vikram Krishnamurthy,et al.  Adaptive Scheme for Caching YouTube Content in a Cellular Network: Machine Learning Approach , 2017, IEEE Access.

[165]  Richard Piper,et al.  An overview of gradient descent optimization algorithms , 2016 .

[166]  Mérouane Debbah,et al.  On the benefits of edge caching for MIMO interference alignment , 2015, 2015 IEEE 16th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[167]  Walid Saad,et al.  Echo State Networks for Proactive Caching in Cloud-Based Radio Access Networks With Mobile Users , 2016, IEEE Transactions on Wireless Communications.

[168]  Muhammad Ali Imran,et al.  A Survey of Self Organisation in Future Cellular Networks , 2013, IEEE Communications Surveys & Tutorials.

[169]  Tomoaki Ohtsuki,et al.  Cell range expansion using distributed Q-learning in heterogeneous networks , 2013, 2013 IEEE 78th Vehicular Technology Conference (VTC Fall).

[170]  Brian Everitt,et al.  Miscellaneous Clustering Methods , 2011 .