Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural Networks

Next-generation wireless networks must support ultra-reliable, low-latency communication and intelligently manage a massive number of Internet of Things (IoT) devices in real-time, within a highly dynamic environment. This need for stringent communication quality-of-service (QoS) requirements as well as mobile edge and core intelligence can only be realized by integrating fundamental notions of artificial intelligence (AI) and machine learning across the wireless infrastructure and end-user devices. In this context, this paper provides a comprehensive tutorial that introduces the main concepts of machine learning, in general, and artificial neural networks (ANNs), in particular, and their potential applications in wireless communications. For this purpose, we present a comprehensive overview on a number of key types of neural networks that include feed-forward, recurrent, spiking, and deep neural networks. For each type of neural network, we present the basic architecture and training procedure, as well as the associated challenges and opportunities. Then, we provide an in-depth overview on the variety of wireless communication problems that can be addressed using ANNs, ranging from communication using unmanned aerial vehicles to virtual reality and edge caching.For each individual application, we present the main motivation for using ANNs along with the associated challenges while also providing a detailed example for a use case scenario and outlining future works that can be addressed using ANNs. In a nutshell, this article constitutes one of the first holistic tutorials on the development of machine learning techniques tailored to the needs of future wireless networks.

[1]  Mugen Peng,et al.  Deep Reinforcement Learning-Based Mode Selection and Resource Management for Green Fog Radio Access Networks , 2018, IEEE Internet of Things Journal.

[2]  Walid Saad,et al.  Toward Massive Machine Type Cellular Communications , 2017, IEEE Wireless Communications.

[3]  Walid Saad,et al.  Joint Millimeter Wave and Microwave Resources Allocation in Cellular Networks With Dual-Mode Base Stations , 2016, IEEE Transactions on Wireless Communications.

[4]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[5]  Feng Qian,et al.  Optimizing 360 video delivery over cellular networks , 2016, ATC@MobiCom.

[6]  Walid Saad,et al.  Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience , 2016, IEEE Journal on Selected Areas in Communications.

[7]  Basabi Chakraborty,et al.  A novel normalization technique for unsupervised learning in ANN , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  Claudio Gallicchio,et al.  Deep Reservoir Computing: A Critical Analysis , 2016, ESANN.

[9]  Wolfgang Maass,et al.  Liquid State Machines: Motivation, Theory, and Applications , 2010 .

[10]  Nei Kato,et al.  Internet of Things (IoT): Present State and Future Prospects , 2014, IEICE Trans. Inf. Syst..

[11]  Navrati Saxena,et al.  Next Generation 5G Wireless Networks: A Comprehensive Survey , 2016, IEEE Communications Surveys & Tutorials.

[12]  Patricia Melin,et al.  Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition , 2011, Studies in Computational Intelligence.

[13]  Ronald J. Williams,et al.  Experimental Analysis of the Real-time Recurrent Learning Algorithm , 1989 .

[14]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[15]  Jun Wang,et al.  Analysis and Design of a $k$ -Winners-Take-All Model With a Single State Variable and the Heaviside Step Activation Function , 2010, IEEE Transactions on Neural Networks.

[16]  Walid Saad,et al.  Communications and Control for Wireless Drone-Based Antenna Array , 2017, IEEE Transactions on Communications.

[17]  Mohsen Guizani,et al.  Smart Cities: A Survey on Data Management, Security, and Enabling Technologies , 2017, IEEE Communications Surveys & Tutorials.

[18]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[19]  Walid Saad,et al.  Performance Analysis of Integrated Sub-6 GHz-Millimeter Wave Wireless Local Area Networks , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[20]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Mehdi Bennis,et al.  UAV-Assisted Heterogeneous Networks for Capacity Enhancement , 2016, IEEE Communications Letters.

[22]  Zhu Han,et al.  Data Collection and Wireless Communication in Internet of Things (IoT) Using Economic Analysis and Pricing Models: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[23]  Robert M. Pap,et al.  Handbook of neural computing applications , 1990 .

[24]  Ilyas Alper Karatepe,et al.  Big data caching for networking: moving from cloud to edge , 2016, IEEE Communications Magazine.

[25]  Samson Lasaulce,et al.  Learning equilibria with partial information in decentralized wireless networks , 2011, IEEE Communications Magazine.

[26]  Walid Saad,et al.  Proactive edge computing in latency-constrained fog networks , 2017, 2017 European Conference on Networks and Communications (EuCNC).

[27]  Walid Saad,et al.  Joint Communication and Control for Wireless Autonomous Vehicular Platoon Systems , 2018, IEEE Transactions on Communications.

[28]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[29]  Jorg Conradt,et al.  The Next Generation Neural Networks: Deep Learning and Spiking Neural Networks , 2014 .

[30]  Xiaolei Dong,et al.  Security and Privacy for Cloud-Based IoT: Challenges , 2017, IEEE Communications Magazine.

[31]  Walid Saad,et al.  Liquid State Machine Learning for Resource and Cache Management in LTE-U Unmanned Aerial Vehicle (UAV) Networks , 2018, IEEE Transactions on Wireless Communications.

[32]  Abdelkader Benyettou,et al.  The leaky integrate-and-fire neuron model for a rigid and a non-rigid object tracking , 2018, ICSE 2018.

[33]  Ursula Challita,et al.  Deep Learning for Proactive Resource Allocation in LTE-U Networks , 2017 .

[34]  P Bourgine,et al.  Towards a Practice of Autonomous Systems , 1992 .

[35]  Stephen Mann,et al.  Geometric algebra for computer science - an object-oriented approach to geometry , 2007, The Morgan Kaufmann series in computer graphics.

[36]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[37]  Sam Romano,et al.  A neural network proxy cache replacement strategy and its implementation in the Squid proxy server , 2010, Neural Computing and Applications.

[38]  Ridha Hambli,et al.  Real-time deformation of structure using finite element and neural networks in virtual reality applications , 2006 .

[39]  Deyou Xu A Neural Network Approach for Hand Gesture Recognition in Virtual Reality Driving Training System of SPG , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[40]  Rui Zhang,et al.  Wireless communications with unmanned aerial vehicles: opportunities and challenges , 2016, IEEE Communications Magazine.

[41]  Stefano Panzieri,et al.  Urban traffic flow forecasting through statistical and neural network bagging ensemble hybrid modeling , 2015, Neurocomputing.

[42]  J. Mark Introduction to radial basis function networks , 1996 .

[43]  L. Bushnell,et al.  Spike-timing error backpropagation in theta neuron networks. , 2009, Neural computation.

[44]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[45]  Rao S. Govindaraju,et al.  Prediction of watershed runoff using Bayesian concepts and modular neural networks , 2000 .

[46]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[47]  Ayhan Demiriz,et al.  Semi-Supervised Support Vector Machines , 1998, NIPS.

[48]  Zaher Dawy,et al.  A chance constrained approach for LTE cellular network planning under uncertainty , 2016, Comput. Commun..

[49]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[50]  Walid Saad,et al.  Echo-Liquid State Deep Learning for 360° Content Transmission and Caching in Wireless VR Networks With Cellular-Connected UAVs , 2018, IEEE Transactions on Communications.

[51]  Herbert Jaeger,et al.  Controlling Recurrent Neural Networks by Conceptors , 2014, ArXiv.

[52]  Petar Popovski,et al.  Ultra-reliable communication in 5G wireless systems , 2014, 1st International Conference on 5G for Ubiquitous Connectivity.

[53]  Geng Wu,et al.  5G Network Capacity: Key Elements and Technologies , 2014, IEEE Vehicular Technology Magazine.

[54]  Tarik Taleb,et al.  UAV Selection for a UAV-Based Integrative IoT Platform , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[55]  Walid Saad,et al.  Echo State Networks for Self-Organizing Resource Allocation in LTE-U With Uplink–Downlink Decoupling , 2016, IEEE Transactions on Wireless Communications.

[56]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[57]  José Carlos Príncipe,et al.  Water Inflow Forecasting using the Echo State Network: a Brazilian Case Study , 2007, 2007 International Joint Conference on Neural Networks.

[58]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[59]  Yi Lu Murphey,et al.  Intelligent Vehicle Power Control Based on Machine Learning of Optimal Control Parameters and Prediction of Road Type and Traffic Congestion , 2009, IEEE Transactions on Vehicular Technology.

[60]  Timothy J. O'Shea,et al.  Deep Learning Based MIMO Communications , 2017, ArXiv.

[61]  Andrew Fish,et al.  An Investigation on Online Versus Batch Learning in Predicting User Behaviour , 2016, SGAI Conf..

[62]  Er Meng Joo,et al.  A survey of machine learning in Wireless Sensor netoworks From networking and application perspectives , 2007, 2007 6th International Conference on Information, Communications & Signal Processing.

[63]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[64]  Deverajan Ganesh Gopal,et al.  Emerging Technologies and Applications for Cloud-Based Gaming: Review on Cloud Gaming Architectures , 2017 .

[65]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[66]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[67]  Ami Wiesel,et al.  Deep MIMO detection , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[68]  Huansheng Ning,et al.  Future Internet of Things Architecture: Like Mankind Neural System or Social Organization Framework? , 2011, IEEE Communications Letters.

[69]  Linda Doyle,et al.  A neural-network-based realization of in-network computation for the Internet of Things , 2017, 2017 IEEE International Conference on Communications (ICC).

[70]  Nirvana Meratnia,et al.  Outlier Detection Techniques for Wireless Sensor Networks: A Survey , 2008, IEEE Communications Surveys & Tutorials.

[71]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[72]  Chi Harold Liu,et al.  Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach , 2018, IEEE Journal on Selected Areas in Communications.

[73]  Daniel Denkovski,et al.  Radio access technology classification for cognitive radio networks , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[74]  Dan Wang,et al.  Sublinear Algorithms for Big Data Applications , 2015, SpringerBriefs in Computer Science.

[75]  Peter Tiño,et al.  Minimum Complexity Echo State Network , 2011, IEEE Transactions on Neural Networks.

[76]  Oriol Sallent,et al.  A Robustness Analysis of Learning-Based Coexistence Mechanisms for LTE-U Operation in Non-Stationary Conditions , 2015, 2015 IEEE 82nd Vehicular Technology Conference (VTC2015-Fall).

[77]  Richard Demo Souza,et al.  A Survey of Machine Learning Techniques Applied to Self-Organizing Cellular Networks , 2017, IEEE Communications Surveys & Tutorials.

[78]  Chang Liu,et al.  Learning a deep neural net policy for end-to-end control of autonomous vehicles , 2017, 2017 American Control Conference (ACC).

[79]  Vir V. Phoha,et al.  An Adaptive Web Cache Access Predictor Using Neural Network , 2002, IEA/AIE.

[80]  Jürgen Schmidhuber,et al.  Learning Complex, Extended Sequences Using the Principle of History Compression , 1992, Neural Computation.

[81]  B. Farhang-Boroujeny,et al.  Adaptive Filters: Theory and Applications , 1999 .

[82]  Sergio Barbarossa,et al.  Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing , 2014, IEEE Transactions on Signal and Information Processing over Networks.

[83]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[84]  Ali E. Abbas,et al.  Constructing Multiattribute Utility Functions for Decision Analysis , 2010 .

[85]  Christopher Leckie,et al.  Parking availability prediction for sensor-enabled car parks in smart cities , 2015, 2015 IEEE Tenth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[86]  Mehdi Bennis,et al.  Decentralized Cross-Tier Interference Mitigation in Cognitive Femtocell Networks , 2011, 2011 IEEE International Conference on Communications (ICC).

[87]  Rangachar Kasturi,et al.  Autonomous Driving Challenge: To Infer the Property of a Dynamic Object Based on Its Motion Pattern , 2016, ECCV Workshops.

[88]  Gianluca Baldassarre,et al.  A modular neural-network model of the basal ganglia’s role in learning and selecting motor behaviours , 2002, Cognitive Systems Research.

[89]  Mehdi Bennis,et al.  Big data meets telcos: A proactive caching perspective , 2015, Journal of Communications and Networks.

[90]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[91]  Walid Saad,et al.  Context-Aware Small Cell Networks: How Social Metrics Improve Wireless Resource Allocation , 2015, IEEE Transactions on Wireless Communications.

[92]  Walid Saad,et al.  Virtual Reality Over Wireless Networks: Quality-of-Service Model and Learning-Based Resource Management , 2017, IEEE Transactions on Communications.

[93]  Walid Saad,et al.  Inter-Operator Resource Management for Millimeter Wave Multi-Hop Backhaul Networks , 2017, IEEE Transactions on Wireless Communications.

[94]  David Burshtein,et al.  Deep Learning Methods for Improved Decoding of Linear Codes , 2017, IEEE Journal of Selected Topics in Signal Processing.

[95]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[96]  Walid Saad,et al.  Wireless Communication Using Unmanned Aerial Vehicles (UAVs): Optimal Transport Theory for Hover Time Optimization , 2017, IEEE Transactions on Wireless Communications.

[97]  Walid Saad,et al.  Network Formation in the Sky: Unmanned Aerial Vehicles for Multi-Hop Wireless Backhauling , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[98]  E. Zafiriou,et al.  Use of neural networks for sensor failure detection in a control system , 1990, IEEE Control Systems Magazine.

[99]  Xuemin Shen,et al.  Link duration estimation using neural networks based mobility prediction in vehicular networks , 2016, 2016 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[100]  Meng Joo Er,et al.  Face recognition with radial basis function (RBF) neural networks , 2002, IEEE Trans. Neural Networks.

[101]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[102]  Xuelong Li,et al.  Recent Advances in Cloud Radio Access Networks: System Architectures, Key Techniques, and Open Issues , 2016, IEEE Communications Surveys & Tutorials.

[103]  Yongming Huang,et al.  Placement Delivery Array Design via Attention-Based Sequence-to-Sequence Model With Deep Neural Network , 2019, IEEE Wireless Communications Letters.

[104]  Walid Saad,et al.  Matching theory for future wireless networks: fundamentals and applications , 2014, IEEE Communications Magazine.

[105]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[106]  Nikos D. Sidiropoulos,et al.  Learning to optimize: Training deep neural networks for wireless resource management , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[107]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[108]  Jeffrey G. Andrews,et al.  What Will 5G Be? , 2014, IEEE Journal on Selected Areas in Communications.

[109]  Chai-Keong Toh Maximum battery life routing to support ubiquitous mobile computing in wireless ad hoc networks , 2001 .

[110]  M. Wiering,et al.  Liquid State Machine Optimization , 2007 .

[111]  Sudharman K. Jayaweera,et al.  A Survey on Machine-Learning Techniques in Cognitive Radios , 2013, IEEE Communications Surveys & Tutorials.

[112]  Mohsen Guizani,et al.  Deep Learning for IoT Big Data and Streaming Analytics: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[113]  Ying-Chang Liang,et al.  Applications of Deep Reinforcement Learning in Communications and Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[114]  Long-Ji Lin,et al.  Reinforcement learning for robots using neural networks , 1992 .

[115]  Y.-P. Eric Wang,et al.  Analysis of ultra-reliable and low-latency 5G communication for a factory automation use case , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[116]  Jean-Michel Deniau,et al.  Cell‐specific spike‐timing‐dependent plasticity in GABAergic and cholinergic interneurons in corticostriatal rat brain slices , 2008, The Journal of physiology.

[117]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[118]  Zhi Ding,et al.  Wireless communications in the era of big data , 2015, IEEE Communications Magazine.

[119]  Cong Shen,et al.  An Iterative BP-CNN Architecture for Channel Decoding , 2017, IEEE Journal of Selected Topics in Signal Processing.

[120]  Johann M. Marquez-Barja,et al.  5G: Adaptable Networks Enabled by Versatile Radio Access Technologies , 2017, IEEE Communications Surveys & Tutorials.

[121]  Hwee Pink Tan,et al.  Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications , 2014, IEEE Communications Surveys & Tutorials.

[122]  Piero Mussio,et al.  Toward a Practice of Autonomous Systems , 1994 .

[123]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[124]  Uwe Meier,et al.  Wireless interference identification with convolutional neural networks , 2017, 2017 IEEE 15th International Conference on Industrial Informatics (INDIN).

[125]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[126]  Aiiad Albeshri,et al.  Analysis of Eight Data Mining Algorithms for Smarter Internet of Things (IoT) , 2016, EUSPN/ICTH.

[127]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[128]  Hubertus Feussner,et al.  Enabling Real-Time Context-Aware Collaboration through 5G and Mobile Edge Computing , 2015, 2015 12th International Conference on Information Technology - New Generations.

[129]  Walid Saad,et al.  Echo state transfer learning for data correlation aware resource allocation in wireless virtual reality , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[130]  Martin T. Hagan,et al.  Neural network design , 1995 .

[131]  Pierre Baldi,et al.  Gradient descent learning algorithm overview: a general dynamical systems perspective , 1995, IEEE Trans. Neural Networks.

[132]  Tobi Delbrück,et al.  Training Deep Spiking Neural Networks Using Backpropagation , 2016, Front. Neurosci..

[133]  Jeffrey G. Andrews,et al.  Seven ways that HetNets are a cellular paradigm shift , 2013, IEEE Communications Magazine.

[134]  András Lörincz,et al.  Reinforcement Learning with Echo State Networks , 2006, ICANN.

[135]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[136]  Nei Kato,et al.  The Deep Learning Vision for Heterogeneous Network Traffic Control: Proposal, Challenges, and Future Perspective , 2017, IEEE Wireless Communications.

[137]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[138]  Mohamed S. Kamel,et al.  Modular Neural Network Classifiers: A Comparative Study , 1998, J. Intell. Robotic Syst..

[139]  Peter Rossmanith,et al.  Simulated Annealing , 2008, Taschenbuch der Algorithmen.

[140]  J.J. Steil,et al.  Backpropagation-decorrelation: online recurrent learning with O(N) complexity , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[141]  Rahim Tafazolli,et al.  A Comparison Between the Centralized and Distributed Approaches for Spectrum Management , 2011, IEEE Communications Surveys & Tutorials.

[142]  Khaled Ben Letaief,et al.  Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices , 2016, IEEE Journal on Selected Areas in Communications.

[143]  Hala ElAarag,et al.  Web proxy cache replacement scheme based on back-propagation neural network , 2008, J. Syst. Softw..

[144]  J. Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM networks , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[145]  Walid Saad,et al.  Proactive Resource Management for LTE in Unlicensed Spectrum: A Deep Learning Perspective , 2017, IEEE Transactions on Wireless Communications.

[146]  Leslie S. Smith,et al.  Neuromorphic Systems: Engineering Silicon from Neurobiology , 1998 .

[147]  Georg Holzmann Echo State Networks in Audio Processing , 2007 .

[148]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[149]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[150]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[151]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[152]  Sangtae Ha,et al.  TUBE: time-dependent pricing for mobile data , 2012, SIGCOMM '12.

[153]  Mehdi Bennis,et al.  Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers , 2016, IEEE Communications Magazine.

[154]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[155]  Ralf Salomon,et al.  Gesture recognition for virtual reality applications using data gloves and neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[156]  Patrick Doherty,et al.  An image matching system for autonomous UAV navigation based on neural network , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[157]  J. E. Matser Structured Liquids in Liquid State Machines , 2011 .

[158]  Patrick van der Smagt,et al.  Introduction to neural networks , 1995, The Lancet.

[159]  Moses Soh Learning Cnn Lstm Architectures For Image Caption Generation , 2016 .

[160]  Lennart Ljung,et al.  Nonlinear black-box modeling in system identification: a unified overview , 1995, Autom..

[161]  Petar Popovski,et al.  Towards Massive, Ultra-Reliable, and Low-Latency Wireless Communication with Short Packets , 2015 .

[162]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[163]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[164]  P J Webros BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[165]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[166]  Mahesh K. Marina,et al.  Holistic Small Cell Traffic Balancing across Licensed and Unlicensed Bands , 2016, MSWiM.

[167]  George Drettakis,et al.  Gaze prediction using machine learning for dynamic stereo manipulation in games , 2016, 2016 IEEE Virtual Reality (VR).

[168]  Dapeng Wu,et al.  Effective capacity-based quality of service measures for wireless networks , 2004, First International Conference on Broadband Networks.

[169]  Ali Farhadi,et al.  Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networks , 2016, ECCV.

[170]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[171]  Geoffrey Ye Li,et al.  Deep Learning-Based Channel Estimation for Beamspace mmWave Massive MIMO Systems , 2018, IEEE Wireless Communications Letters.

[172]  Mugen Peng,et al.  Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues , 2018, IEEE Communications Surveys & Tutorials.

[173]  R. J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[174]  Byung-Seo Kim,et al.  Internet of Things (IoT) Operating Systems Support, Networking Technologies, Applications, and Challenges: A Comparative Review , 2018, IEEE Communications Surveys & Tutorials.

[175]  Rongqing Xu,et al.  A Multi-radio Packet Scheduling Algorithm for Real-time Traffic in a Heterogeneous Wireless Network Environment , 2011 .

[176]  Meryem Simsek,et al.  When cellular meets WiFi in wireless small cell networks , 2013, IEEE Communications Magazine.

[177]  B. Schrauwen,et al.  Isolated word recognition with the Liquid State Machine: a case study , 2005, Inf. Process. Lett..

[178]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[179]  Vikram Krishnamurthy,et al.  Adaptive Scheme for Caching YouTube Content in a Cellular Network: Machine Learning Approach , 2017, IEEE Access.

[180]  Walid Saad,et al.  Echo State Networks for Proactive Caching in Cloud-Based Radio Access Networks With Mobile Users , 2016, IEEE Transactions on Wireless Communications.

[181]  Christopher M. Bishop,et al.  Current address: Microsoft Research, , 2022 .

[182]  Y.-P. Eric Wang,et al.  Radio access for ultra-reliable and low-latency 5G communications , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[183]  Xiaohu You,et al.  AI for 5G: research directions and paradigms , 2018, Science China Information Sciences.

[184]  S. Wang,et al.  Malleability of Spike-Timing-Dependent Plasticity at the CA3–CA1 Synapse , 2006, The Journal of Neuroscience.

[185]  A. Seminar,et al.  The Next Generation Neural Networks : Deep Learning and Spiking Neural Networks , 2014 .

[186]  Walid Saad,et al.  Liquid State Machine Learning for Resource Allocation in a Network of Cache-Enabled LTE-U UAVs , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[187]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[188]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[189]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[190]  Walid Saad,et al.  Game theory for secure critical interdependent gas-power-water infrastructure , 2017, 2017 Resilience Week (RWS).

[191]  Tarik Taleb,et al.  UAV-Based IoT Platform: A Crowd Surveillance Use Case , 2017, IEEE Communications Magazine.

[192]  Sander M. Bohte,et al.  Computing with Spiking Neuron Networks , 2012, Handbook of Natural Computing.

[193]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[194]  Xiong Luo,et al.  A laguerre neural network-based ADP learning scheme with its application to tracking control in the Internet of Things , 2016, Personal and Ubiquitous Computing.

[195]  Jacob M.J. Murre,et al.  Learning and Categorization in Modular Neural Networks , 1992 .

[196]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[197]  Yen-Cheng Kuan,et al.  A Reconfigurable Streaming Deep Convolutional Neural Network Accelerator for Internet of Things , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[198]  Ejaz Ahmed,et al.  A survey on mobile edge computing , 2016, 2016 10th International Conference on Intelligent Systems and Control (ISCO).

[199]  T. Charles Clancy,et al.  Convolutional Radio Modulation Recognition Networks , 2016, EANN.

[200]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[201]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[202]  Sheng Chen,et al.  A clustering technique for digital communications channel equalization using radial basis function networks , 1993, IEEE Trans. Neural Networks.

[203]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[204]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[205]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[206]  Jaime Llorca,et al.  Coding for Caching in 5G Networks , 2017, IEEE Communications Magazine.

[207]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[208]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[209]  Urs Niesen,et al.  Coding for caching: fundamental limits and practical challenges , 2016, IEEE Communications Magazine.

[210]  F. Richard Yu,et al.  A Survey of Machine Learning Techniques Applied to Software Defined Networking (SDN): Research Issues and Challenges , 2019, IEEE Communications Surveys & Tutorials.

[211]  Jaime G. Carbonell,et al.  An Overview of Machine Learning , 1983 .

[212]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[213]  Max A. Viergever,et al.  Adaptive Stochastic Gradient Descent Optimisation for Image Registration , 2009, International Journal of Computer Vision.

[214]  J. Adamowski,et al.  Forecasting Urban Water Demand Via Wavelet-Denoising and Neural Network Models. Case Study: City of Syracuse, Italy , 2012, Water Resources Management.

[215]  Farid Melgani,et al.  Multilabel classification of UAV images with Convolutional Neural Networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[216]  Oriol Sallent,et al.  Joint radio resource management algorithm for multi-RAT networks , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[217]  Timothy J. O'Shea,et al.  An Introduction to Machine Learning Communications Systems , 2017, ArXiv.

[218]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[219]  Walid Saad,et al.  Proactive Resource Management in LTE-U Systems: A Deep Learning Perspective , 2017, ArXiv.

[220]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[221]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[222]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[223]  Henry Markram,et al.  On the computational power of circuits of spiking neurons , 2004, J. Comput. Syst. Sci..

[224]  Qi Hao,et al.  Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.

[225]  Walid Saad,et al.  Learning How to Communicate in the Internet of Things: Finite Resources and Heterogeneity , 2016, IEEE Access.

[226]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[227]  Robert W. Heath,et al.  Five disruptive technology directions for 5G , 2013, IEEE Communications Magazine.

[228]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[229]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[230]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[231]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[232]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[233]  Wulfram Gerstner,et al.  Reduction of the Hodgkin-Huxley Equations to a Single-Variable Threshold Model , 1997, Neural Computation.

[234]  Kiran Karra,et al.  Learning approximate neural estimators for wireless channel state information , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[235]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[236]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[237]  Mehdi Bennis,et al.  Living on the edge: The role of proactive caching in 5G wireless networks , 2014, IEEE Communications Magazine.

[238]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[239]  Bernard Cousin,et al.  A Network-Assisted Approach for RAT Selection in Heterogeneous Cellular Networks , 2015, IEEE Journal on Selected Areas in Communications.

[240]  Sarangapani Jagannathan,et al.  Neural Network-Based Optimal Adaptive Output Feedback Control of a Helicopter UAV , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[241]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[242]  Eylem Ekici,et al.  Vehicular Networking: A Survey and Tutorial on Requirements, Architectures, Challenges, Standards and Solutions , 2011, IEEE Communications Surveys & Tutorials.

[243]  Mykel J. Kochenderfer,et al.  Analysis of Recurrent Neural Networks for Probabilistic Modeling of Driver Behavior , 2017, IEEE Transactions on Intelligent Transportation Systems.

[244]  Xuyuan Kang,et al.  High-Accuracy Entity State Prediction Method Based on Deep Belief Network Toward IoT Search , 2019, IEEE Wireless Communications Letters.

[245]  Alberto L. Sangiovanni-Vincentelli,et al.  Systematic Testing of Convolutional Neural Networks for Autonomous Driving , 2017, ArXiv.

[246]  Mohsen Guizani,et al.  Internet of Things Architecture: Recent Advances, Taxonomy, Requirements, and Open Challenges , 2017, IEEE Wireless Communications.