Machine Learning for Wireless Communications in the Internet of Things: A Comprehensive Survey

Abstract The Internet of Things (IoT) is expected to require more effective and efficient wireless communications than ever before. For this reason, techniques such as spectrum sharing, dynamic spectrum access, extraction of signal intelligence and optimized routing will soon become essential components of the IoT wireless communication paradigm. In this vision, IoT devices must be able to not only learn to autonomously extract spectrum knowledge on-the-fly from the network but also leverage such knowledge to dynamically change appropriate wireless parameters ( e.g. , frequency band, symbol modulation, coding rate, route selection, etc.) to reach the network’s optimal operating point. Given that the majority of the IoT will be composed of tiny, mobile, and energy-constrained devices, traditional techniques based on a priori network optimization may not be suitable, since (i) an accurate model of the environment may not be readily available in practical scenarios; (ii) the computational requirements of traditional optimization techniques may prove unbearable for IoT devices. To address the above challenges, much research has been devoted to exploring the use of machine learning to address problems in the IoT wireless communications domain. The reason behind machine learning’s popularity is that it provides a general framework to solve very complex problems where a model of the phenomenon being learned is too complex to derive or too dynamic to be summarized in mathematical terms. This work provides a comprehensive survey of the state of the art in the application of machine learning techniques to address key problems in IoT wireless communications with an emphasis on its ad hoc networking aspect. First, we present extensive background notions of machine learning techniques. Then, by adopting a bottom-up approach, we examine existing work on machine learning for the IoT at the physical, data-link and network layer of the protocol stack. Thereafter, we discuss directions taken by the community towards hardware implementation to ensure the feasibility of these techniques. Additionally, before concluding, we also provide a brief discussion of the application of machine learning in IoT beyond wireless communication. Finally, each of these discussions is accompanied by a detailed analysis of the related open problems and challenges.

[1]  Qihui Wu,et al.  Cognitive Internet of Things: A New Paradigm Beyond Connection , 2014, IEEE Internet of Things Journal.

[2]  Yoshio Karasawa,et al.  Automatic Modulation Identification Based on the Probability Density Function of Signal Phase , 2012, IEEE Transactions on Communications.

[3]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[4]  Pramod K. Varshney,et al.  Hybrid Maximum Likelihood Modulation Classification Using Multiple Radios , 2013, IEEE Communications Letters.

[5]  Paulo Henrique Portela de Carvalho,et al.  A flexible framework based on reinforcement learning for adaptive modulation and coding in OFDM wireless systems , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[6]  Deborah Estrin,et al.  Directed diffusion: a scalable and robust communication paradigm for sensor networks , 2000, MobiCom '00.

[7]  Nei Kato,et al.  Routing or Computing? The Paradigm Shift Towards Intelligent Computer Network Packet Transmission Based on Deep Learning , 2017, IEEE Transactions on Computers.

[8]  Li Li,et al.  A cloud-based spectrum environment awareness system , 2017, 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[9]  Igor Kotenko,et al.  Neural network approach to forecast the state of the Internet of Things elements , 2015, 2015 XVIII International Conference on Soft Computing and Measurements (SCM).

[10]  Ahmed Faisal,et al.  Optimization of channel allocation in wireless body area networks by means of reinforcement learning , 2016 .

[11]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[12]  Aamir Mahmood,et al.  An SVM-Based Method for Classification of External Interference in Industrial Wireless Sensor and Actuator Networks , 2017, J. Sens. Actuator Networks.

[13]  Ganesh K. Venayagamoorthy,et al.  Neural network based secure media access control protocol for wireless sensor networks , 2009, 2009 International Joint Conference on Neural Networks.

[14]  Josh Petersen,et al.  Modulation recognition using hierarchical deep neural networks , 2017, 2017 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  George A. Constantinides,et al.  High-level synthesis of dynamic data structures: A case study using Vivado HLS , 2013, 2013 International Conference on Field-Programmable Technology (FPT).

[17]  Husheng Li,et al.  Multiagent -Learning for Aloha-Like Spectrum Access in Cognitive Radio Systems , 2010 .

[18]  K. J. Ray Liu,et al.  Near-optimal reinforcement learning framework for energy-aware sensor communications , 2005, IEEE Journal on Selected Areas in Communications.

[19]  Jan M. Rabaey,et al.  Energy aware routing for low energy ad hoc sensor networks , 2002, 2002 IEEE Wireless Communications and Networking Conference Record. WCNC 2002 (Cat. No.02TH8609).

[20]  Carsten Griwodz,et al.  A Deep Learning based Approach for Indoor Localization A short review for “CSI-based fingerprinting for indoor localization: A deep learning , 2018 .

[21]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[22]  Uwe Meier,et al.  Wireless interference identification with convolutional neural networks , 2017, 2017 IEEE 15th International Conference on Industrial Informatics (INDIN).

[23]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[24]  Muhammed Fahri Unlersen,et al.  Direction of Arrival Estimation by Using Artificial Neural Networks , 2016, 2016 European Modelling Symposium (EMS).

[25]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[26]  Kobi Cohen,et al.  Deep Multi-User Reinforcement Learning for Dynamic Spectrum Access in Multichannel Wireless Networks , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[27]  Murat Torlak,et al.  Network Throughput Optimization for Random Access Narrowband Cognitive Radio Internet of Things (NB-CR-IoT) , 2018, IEEE Internet of Things Journal.

[28]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[29]  Wahidah Hashim,et al.  Channel selection in multi-hop cognitive radio network using reinforcement learning: An experimental study , 2014 .

[30]  Sheetal Kalyani,et al.  A Non-parametric Multi-stage Learning Framework for Cognitive Spectrum Access in IoT Networks , 2018, ArXiv.

[31]  Ilangko Balasingham,et al.  Cognitive radio for medical wireless body area networks , 2011, 2011 IEEE 16th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD).

[32]  Evgeny Efimov,et al.  Angle of arrival estimator based on artificial neural networks , 2016, 2016 17th International Radar Symposium (IRS).

[33]  Pramod K. Varshney,et al.  Artificial Neural Network Based Automatic Modulation Classification over a Software Defined Radio Testbed , 2018, 2018 IEEE International Conference on Communications (ICC).

[34]  Y. T. Zhou,et al.  Computation of optical flow using a neural network , 1988, IEEE 1988 International Conference on Neural Networks.

[35]  Mohamed F. Younis,et al.  A survey on routing protocols for wireless sensor networks , 2005, Ad Hoc Networks.

[36]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[37]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[38]  Carlo Fischione,et al.  Spectrum Sharing in mmWave Cellular Networks via Cell Association, Coordination, and Beamforming , 2016, IEEE Journal on Selected Areas in Communications.

[39]  Xiaohui Ye,et al.  Cognitive Network Management with Reinforcement Learning for Wireless Mesh Networks , 2007, IPOM.

[40]  Kang G. Shin,et al.  Opportunistic spectrum access for mobile cognitive radios , 2011, 2011 Proceedings IEEE INFOCOM.

[41]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  T. Charles Clancy,et al.  Over-the-Air Deep Learning Based Radio Signal Classification , 2017, IEEE Journal of Selected Topics in Signal Processing.

[43]  Deniz Erdogmus,et al.  Generalized information potential criterion for adaptive system training , 2002, IEEE Trans. Neural Networks.

[44]  Vincent Nicomette,et al.  Toward an Intrusion Detection Approach for IoT Based on Radio Communications Profiling , 2017, 2017 13th European Dependable Computing Conference (EDCC).

[45]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[46]  Amit Sheth Transforming Big Data into Smart Data: Deriving value via harnessing Volume, Variety, and Velocity using semantic techniques and technologies , 2014, ICDE.

[47]  Jiming Chen,et al.  Sensing-Performance Tradeoff in Cognitive Radio Enabled Smart Grid , 2013, IEEE Transactions on Smart Grid.

[48]  C. Cordeiro,et al.  C-MAC: A Cognitive MAC Protocol for Multi-Channel Wireless Networks , 2007, 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[49]  Eric V. Denardo,et al.  Flows in Networks , 2011 .

[50]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[51]  Pramod K. Varshney,et al.  Design and evaluation of hierarchical hybrid automatic modulation classifier using software defined radios , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[52]  D. Erdogmus,et al.  Nonlinear channel equalization using multilayer perceptrons with information-theoretic criterion , 2001, Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No.01TH8584).

[53]  Ingrid Moerman,et al.  End-to-End Learning From Spectrum Data: A Deep Learning Approach for Wireless Signal Identification in Spectrum Monitoring Applications , 2017, IEEE Access.

[54]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[55]  Anurag Agarwal,et al.  The Internet of Things—A survey of topics and trends , 2015, Inf. Syst. Frontiers.

[56]  Ashwin Amanna,et al.  Realizing Data driven and Hampel preprocessor based Adaptive filtering on a Software Defined Radio testbed: A USRP case Study , 2018, 2018 International Conference on Computing, Networking and Communications (ICNC).

[57]  Kevin Ashton,et al.  That ‘Internet of Things’ Thing , 1999 .

[58]  Muazzam Ali Khan,et al.  Automatic Modulation Recognition of Communication Signals. , 2012 .

[59]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[60]  Amit P. Sheth,et al.  Machine learning for Internet of Things data analysis: A survey , 2017, Digit. Commun. Networks.

[61]  Mihaela van der Schaar,et al.  Joint Physical-Layer and System-Level Power Management for Delay-Sensitive Wireless Communications , 2013, IEEE Transactions on Mobile Computing.

[62]  Pekka Toivanen,et al.  Security Threats in ZigBee-Enabled Systems: Vulnerability Evaluation, Practical Experiments, Countermeasures, and Lessons Learned , 2013, 2013 46th Hawaii International Conference on System Sciences.

[63]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[64]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[65]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[66]  Huazi Zhang,et al.  Performance Evaluation of Channel Decoding with Deep Neural Networks , 2017, 2018 IEEE International Conference on Communications (ICC).

[67]  Mubashir Husain Rehmani,et al.  Cognitive-Radio-Based Internet of Things: Applications, Architectures, Spectrum Related Functionalities, and Future Research Directions , 2017, IEEE Wireless Communications.

[68]  Remi Badonnel,et al.  A Taxonomy of Attacks in RPL-based Internet of Things , 2016, Int. J. Netw. Secur..

[69]  Xin Liu,et al.  A heterogeneous information fusion deep reinforcement learning for intelligent frequency selection of HF communication , 2018, China Communications.

[70]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[71]  Michael Inggs,et al.  A CNN and LSTM-based approach to classifying transient radio frequency interference , 2018, Astron. Comput..

[72]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[73]  MengChu Zhou,et al.  Software-Defined Radio Equipped With Rapid Modulation Recognition , 2010, IEEE Transactions on Vehicular Technology.

[74]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[75]  Chi Zhang,et al.  SpecGuard: Spectrum Misuse Detection in Dynamic Spectrum Access Systems , 2018, IEEE Transactions on Mobile Computing.

[76]  Muhammad Aamir Khan,et al.  A novel learning method to classify data streams in the internet of things , 2014, 2014 National Software Engineering Conference.

[77]  Saleh A. Alshebeili,et al.  Automatic modulation classification of digital modulations in presence of HF noise , 2012, EURASIP Journal on Advances in Signal Processing.

[78]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[79]  T. Zwick,et al.  Neural network based direction of arrival estimation for a MIMO OFDM radar , 2012, 2012 9th European Radar Conference.

[80]  Panos P. Markopoulos,et al.  Small-Sample-Support Suppression of Interference to PN-Masked Data , 2013, IEEE Transactions on Communications.

[81]  Lipo Wang,et al.  Broadcast scheduling in wireless multihop networks using a neural-network-based hybrid algorithm , 2005, Neural Networks.

[82]  Aníbal R. Figueiras-Vidal,et al.  A mixed neural-genetic algorithm for the broadcast scheduling problem , 2003, IEEE Trans. Wirel. Commun..

[83]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[84]  P. G. Poonacha,et al.  An SNR estimation based adaptive hierarchical modulation classification method to recognize M-ary QAM and M-ary PSK signals , 2015, 2015 3rd International Conference on Signal Processing, Communication and Networking (ICSCN).

[85]  Jürgen Schmidhuber,et al.  Highway Networks , 2015, ArXiv.

[86]  J. Heidemann,et al.  Directed Diffusion ∗ , 2004 .

[87]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[88]  Jean-Marie Bonnin,et al.  Cognitive radio for M2M and Internet of Things: A survey , 2016, Comput. Commun..

[89]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[90]  Gisung Kim,et al.  A novel hybrid intrusion detection method integrating anomaly detection with misuse detection , 2014, Expert Syst. Appl..

[91]  Yunsi Fei,et al.  QELAR: A Machine-Learning-Based Adaptive Routing Protocol for Energy-Efficient and Lifetime-Extended Underwater Sensor Networks , 2010, IEEE Transactions on Mobile Computing.

[92]  Yong Xiang,et al.  Software-Defined Wireless Networking Opportunities and Challenges for Internet-of-Things: A Review , 2016, IEEE Internet of Things Journal.

[93]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach (McGraw-Hill Series in Computer Science) , 2004 .

[94]  Imrich Chlamtac,et al.  Internet of things: Vision, applications and research challenges , 2012, Ad Hoc Networks.

[95]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[96]  M. Birgmeier,et al.  A neural network trained with the extended Kalman algorithm used for the equalization of a binary communication channel , 1994, Proceedings of IEEE Workshop on Neural Networks for Signal Processing.

[97]  H. Arslan,et al.  Public Safety and Emergency Case Communications: Opportunities from the Aspect of Cognitive Radio , 2008, 2008 3rd IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[98]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[99]  Mohamed F. Younis,et al.  An energy-aware QoS routing protocol for wireless sensor networks , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..

[100]  Liesbet Van der Perre,et al.  Cross-Layer Framework and Optimization for Efficient Use of the Energy Budget of IoT Nodes , 2019, 2019 IEEE Wireless Communications and Networking Conference (WCNC).

[101]  Si Chen,et al.  Learning in vehicular dynamic spectrum access networks: Opportunities and challenges , 2011, 2011 International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS).

[102]  Andrew L. Drozd,et al.  HELPER: Heterogeneous Efficient Low Power Radio for Enabling Ad Hoc Emergency Public Safety Networks , 2019, Ad Hoc Networks.

[103]  Sunil Kumar,et al.  Medium Access Control protocols for ad hoc wireless networks: A survey , 2006, Ad Hoc Networks.

[104]  Luca Mainetti,et al.  Evolution of wireless sensor networks towards the Internet of Things: A survey , 2011, SoftCOM 2011, 19th International Conference on Software, Telecommunications and Computer Networks.

[105]  Tommaso Melodia,et al.  Design and Experimental Evaluation of a Cross-Layer Deadline-Based Joint Routing and Spectrum Allocation Algorithm , 2019, IEEE Transactions on Mobile Computing.

[106]  Guey-Yun Chang,et al.  Anti-Jamming Rendezvous Scheme for Cognitive Radio Networks , 2017, IEEE Transactions on Mobile Computing.

[107]  Tommaso Melodia,et al.  Cross-layer routing on MIMO-OFDM underwater acoustic links , 2012, 2012 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON).

[108]  Narasimhan Sundararajan,et al.  COMMUNICATION CHANNEL EQUALISATION NEURAL NETWORK , 2000 .

[109]  John F. Doherty,et al.  Modulation Recognition in Continuous Phase Modulation Using Approximate Entropy , 2011, IEEE Transactions on Information Forensics and Security.

[110]  Bishal Thapa,et al.  Machine Learning Approach to RF Transmitter Identification , 2017, IEEE Journal of Radio Frequency Identification.

[111]  Zhi Ding,et al.  Opportunistic spectrum access in cognitive radio networks , 2008, IJCNN.

[112]  Shoji Tatsumi,et al.  Q-MAP: a novel multicast routing method in wireless ad hoc networks with multiagent reinforcement learning , 2002, 2002 IEEE Region 10 Conference on Computers, Communications, Control and Power Engineering. TENCOM '02. Proceedings..

[113]  Ronald Y. Chang,et al.  Machine-Learning Indoor Localization with Access Point Selection and Signal Strength Reconstruction , 2016, 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring).

[114]  Zhe Chen,et al.  Cognitive Radio Network for the Smart Grid: Experimental System Architecture, Control Algorithms, Security, and Microgrid Testbed , 2011, IEEE Transactions on Smart Grid.

[115]  Krishna M. Sivalingam,et al.  Reinforcement Learning Based Geographic Routing Protocol for UWB Wireless Sensor Network , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[116]  Edward Curry,et al.  An Autonomic Approach to Real-Time Predictive Analytics Using Open Data and Internet of Things , 2014, 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops.

[117]  Marwan Krunz,et al.  CDMA-based MAC protocol for wireless ad hoc networks , 2003, MobiHoc '03.

[118]  Michael Georgiopoulos,et al.  Neural-network-based beamforming for interference cancellation , 1998, Defense, Security, and Sensing.

[119]  Oriol Sallent,et al.  ETSI reconfigurable radio systems: status and future directions on software defined radio and cognitive radio standards , 2010, IEEE Communications Magazine.

[120]  Pramod K. Varshney,et al.  Asynchronous Linear Modulation Classification With Multiple Sensors via Generalized EM Algorithm , 2014, IEEE Transactions on Wireless Communications.

[121]  Xiuzhen Cheng,et al.  Dynamic spectrum access: from cognitive radio to network radio , 2012, IEEE Wireless Communications.

[122]  Hang Su,et al.  Opportunistic MAC Protocols for Cognitive Radio Based Wireless Networks , 2007, 2007 41st Annual Conference on Information Sciences and Systems.

[123]  Yifan Sun,et al.  A hybrid MAC protocol with channel-dependent optimized scheduling for clustered underwater acoustic sensor networks , 2013, WUWNet.

[124]  Jun Wu,et al.  Cross-Layer Optimization for Cooperative Content Distribution in Multihop Device-to-Device Networks , 2019, IEEE Internet of Things Journal.

[125]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[126]  Li Li,et al.  IoT-Enabled Machine Learning for an Algorithmic Spectrum Decision Process , 2019, IEEE Internet of Things Journal.

[127]  Yan Zhang,et al.  Dynamic Spectrum Access in Cognitive Radio Wireless Networks , 2008, 2008 IEEE International Conference on Communications.

[128]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[129]  S.H. Zainud-Deen,et al.  Direction of arrival and state of polarization estimation using Radial Basis Function Neural Network (RBFNN) , 2008, 2008 National Radio Science Conference.

[130]  Yi Zhang,et al.  Spectrum Monitoring for Radar Bands Using Deep Convolutional Neural Networks , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[131]  Narasimhan Sundararajan,et al.  Communication channel equalization using complex-valued minimal radial basis function neural networks , 2002, IEEE Trans. Neural Networks.

[132]  Shan Suthaharan,et al.  Big data classification: problems and challenges in network intrusion prediction with machine learning , 2014, PERV.

[133]  Anna Kubankova,et al.  Recognition of digital modulations based on mathematical classifier , 2010 .

[134]  张玲,et al.  MIMO Channel Estimation and Equalization Using Three-Layer Neural Networks with Feedback , 2007 .

[135]  A. Forstert,et al.  FROMS: Feedback Routing for Optimizing Multiple Sinks in WSN with Reinforcement Learning , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[136]  Ming-Shi Wang,et al.  Broadcast scheduling in wireless sensor networks using fuzzy Hopfield neural network , 2008, Expert Syst. Appl..

[137]  Hsin-Piao Lin,et al.  Applying Deep Neural Network (DNN) for Robust Indoor Localization in Multi-Building Environment , 2018, Applied Sciences.

[138]  Chihway Chang,et al.  Radio frequency interference mitigation using deep convolutional neural networks , 2016, Astron. Comput..

[139]  Peng Xie,et al.  VBF: Vector-Based Forwarding Protocol for Underwater Sensor Networks , 2006, Networking.

[140]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[141]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[142]  J. Orbach Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms. , 1962 .

[143]  M. Motani,et al.  Cross-layer design: a survey and the road ahead , 2005, IEEE Communications Magazine.

[144]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[145]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[146]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[147]  Mubashir Husain Rehmani,et al.  When Cognitive Radio meets the Internet of Things? , 2016, 2016 International Wireless Communications and Mobile Computing Conference (IWCMC).

[148]  Tao Jiang,et al.  Deep learning for wireless physical layer: Opportunities and challenges , 2017, China Communications.

[149]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[150]  A. Ghassemi,et al.  Cognitive Radio for Smart Grid Communications , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[151]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[152]  Tommaso Melodia,et al.  DRS: Distributed Deadline-Based Joint Routing and Spectrum Allocation for Tactical Ad-Hoc Networks , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[153]  Dimitris A. Pados,et al.  An iterative algorithm for the computation of the MVDR filter , 2001, IEEE Trans. Signal Process..

[154]  Sang-Won Nam,et al.  Channel equalization for severe intersymbol interference and nonlinearity with a radial basis function neural network , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[155]  Richard Bellman,et al.  ON A ROUTING PROBLEM , 1958 .

[156]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[157]  Hai Jiang,et al.  Cognitive Non-Orthogonal Multiple Access with Cooperative Relaying: A New Wireless Frontier for 5G Spectrum Sharing , 2018, IEEE Communications Magazine.

[158]  Daniel Minoli IPv6 Over Low‐Power WPAN (6Lowpan) , 2013 .

[159]  Mahmood Yousefi-Azar,et al.  Autoencoder-based feature learning for cyber security applications , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[160]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[161]  Giuseppe Thadeu Freitas de Abreu,et al.  Indoor positioning: A key enabling technology for IoT applications , 2014, 2014 IEEE World Forum on Internet of Things (WF-IoT).

[162]  Mohamed M. A. Moustafa,et al.  Channel estimation and equalization using backpropagation neural networks in OFDM systems , 2009, 2009 IFIP International Conference on Wireless and Optical Communications Networks.

[163]  Geoffrey Ye Li,et al.  Initial Results on Deep Learning for Joint Channel Equalization and Decoding , 2017, 2017 IEEE 86th Vehicular Technology Conference (VTC-Fall).

[164]  Carlos León,et al.  A new QoS routing algorithm based on self-organizing maps for wireless sensor networks , 2007, Telecommun. Syst..

[165]  Yair Be'ery,et al.  Learning to decode linear codes using deep learning , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[166]  Swades De,et al.  eDSA: Energy-Efficient Dynamic Spectrum Access Protocols for Cognitive Radio Networks , 2016, IEEE Transactions on Mobile Computing.

[167]  Pramod K. Varshney,et al.  Distributed asynchronous modulation classification based on hybrid maximum likelihood approach , 2015, MILCOM 2015 - 2015 IEEE Military Communications Conference.

[168]  Aditya Trivedi,et al.  Anti-jamming in cognitive radio networks using reinforcement learning algorithms , 2012, 2012 Ninth International Conference on Wireless and Optical Communications Networks (WOCN).

[169]  Wazir Zada Khan,et al.  Edge computing: A survey , 2019, Future Gener. Comput. Syst..

[170]  Sijing Zhang,et al.  Cognitive radio networks for Internet of Things: Applications, challenges and future , 2013, 2013 19th International Conference on Automation and Computing.

[171]  Prem Prakash Jayaraman,et al.  Fog Computing: Survey of Trends, Architectures, Requirements, and Research Directions , 2018, IEEE Access.

[172]  Masashi Hayakawa,et al.  DOA estimation of distributed sources using neural networks , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[173]  Ilangko Balasingham,et al.  Cognitive radio for medical body area networks using ultra wideband , 2012, IEEE Wireless Communications.

[174]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[175]  Rasa Bruzgiene,et al.  MANET Network in Internet of Things System , 2017 .

[176]  Asoke K. Nandi,et al.  Automatic digital modulation recognition using spectral and statistical features with multi-layer perceptrons , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[177]  Soung Chang Liew,et al.  Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks , 2017, 2018 IEEE International Conference on Communications (ICC).

[178]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[179]  Mithra Venkatesan,et al.  Predictive learning model in cognitive radio using reinforcement learning , 2017, 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI).

[180]  Boris Murmann,et al.  Cognitive computation and communication: A complement solution to cloud for IoT , 2016, 2016 International Conference on Advanced Technologies for Communications (ATC).

[181]  Robert W. Heath,et al.  A Machine Learning Approach to Link Adaptation for SC-FDE System , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[182]  Michael Georgiopoulos,et al.  Performance of radial-basis function networks for direction of arrival estimation with antenna arrays , 1997 .

[183]  Tommaso Melodia,et al.  Learning to detect and mitigate cross-layer attacks in wireless networks: Framework and applications , 2017, 2017 IEEE Conference on Communications and Network Security (CNS).

[184]  Lifeng Sun,et al.  QARC: Video Quality Aware Rate Control for Real-Time Video Streaming based on Deep Reinforcement Learning , 2018, ACM Multimedia.

[185]  Pavan Pongle,et al.  A survey: Attacks on RPL and 6LoWPAN in IoT , 2015, 2015 International Conference on Pervasive Computing (ICPC).

[186]  Haibo He,et al.  Reinforcement learning based adaptive rate control for delay-constrained communications over fading channels , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[187]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[188]  Louis-S. Bouchard,et al.  Feature-Preserving Noise Removal , 2015, IEEE Transactions on Medical Imaging.

[189]  P J Webros BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[190]  Thomas Kürner,et al.  Angle of arrival estimation in dynamic indoor THz channels with Bayesian filter and reinforcement learning , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[191]  Kok-Lim Alvin Yau,et al.  On Cognitive Radio-based Wireless Body Area Networks for medical applications , 2013, 2013 IEEE Symposium on Computational Intelligence in Healthcare and e-health (CICARE).

[192]  V. Vapnik Pattern recognition using generalized portrait method , 1963 .

[193]  Daniel Gutiérrez-Reina,et al.  The Role of Ad Hoc Networks in the Internet of Things: A Case Scenario for Smart Environments , 2013, Internet of Things and Inter-cooperative Computational Technologies for Collective Intelligence.

[194]  Jianzhong Zhang,et al.  MIMO Technologies in 3GPP LTE and LTE-Advanced , 2009, EURASIP J. Wirel. Commun. Netw..

[195]  Zhi Chen,et al.  Intelligent Power Control for Spectrum Sharing in Cognitive Radios: A Deep Reinforcement Learning Approach , 2017, IEEE Access.

[196]  Sudharman K. Jayaweera,et al.  A Survey on Machine-Learning Techniques in Cognitive Radios , 2013, IEEE Communications Surveys & Tutorials.

[197]  Dimitri Konstantas,et al.  A Comprehensive IoT Attacks Survey based on a Building-blocked Reference Model , 2018 .

[198]  P. Lawson,et al.  Federal Communications Commission , 2004, Bell Labs Technical Journal.

[199]  Jean-Marie Bonnin,et al.  Cognitive radio for vehicular ad hoc networks (CR-VANETs): approaches and challenges , 2014, EURASIP J. Wirel. Commun. Netw..

[200]  Juan J. Rodríguez-Andina,et al.  Performance Characterization and Design Guidelines for Efficient Processor–FPGA Communication in Cyclone V FPSoCs , 2018, IEEE Transactions on Industrial Electronics.

[201]  Chaofeng Wang,et al.  Reinforcement Learning-Based Adaptive Transmission in Time-Varying Underwater Acoustic Channels , 2018, IEEE Access.

[202]  Adam Doupé,et al.  Deep Android Malware Detection , 2017, CODASPY.

[203]  Lei Liu,et al.  Combining supervised and unsupervised learning for zero-day malware detection , 2013, 2013 Proceedings IEEE INFOCOM.

[204]  Samir Ranjan Das,et al.  A multichannel CSMA MAC protocol with receiver-based channel selection for multihop wireless networks , 2001, Proceedings Tenth International Conference on Computer Communications and Networks (Cat. No.01EX495).

[205]  Walid Saad,et al.  Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural Networks , 2017, ArXiv.

[206]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[207]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[208]  Xiaojiang Du,et al.  A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Security , 2018, IEEE Communications Surveys & Tutorials.

[209]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[210]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[211]  Guey-Yun Chang,et al.  A Jamming-Resistant Channel Hopping Scheme for Cognitive Radio Networks , 2017, IEEE Transactions on Wireless Communications.

[212]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[213]  Kaushik R. Chowdhury,et al.  A survey on MAC protocols for cognitive radio networks , 2009, Ad Hoc Networks.

[214]  Constantine Caramanis,et al.  Reinforcement Learning for Link Adaptation in MIMO-OFDM Wireless Systems , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[215]  Pramod K. Varshney,et al.  Multisensor Modulation Classification (MMC): Implementation Considerations -- USRP Case Study , 2014, 2014 IEEE Military Communications Conference.

[216]  Pablo Torres,et al.  An analysis of Recurrent Neural Networks for Botnet detection behavior , 2016, 2016 IEEE Biennial Congress of Argentina (ARGENCON).

[217]  T. Charles Clancy,et al.  Convolutional Radio Modulation Recognition Networks , 2016, EANN.

[218]  V. Rao Vemuri,et al.  Robust Support Vector Machines for Anomaly Detection in Computer Security , 2003, ICMLA.

[219]  Gerhard Petrus Hancke,et al.  Fast Convergence Cooperative Dynamic Spectrum Access for Cognitive Radio Networks , 2018, IEEE Transactions on Industrial Informatics.

[220]  L. Deng,et al.  The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web] , 2012, IEEE Signal Processing Magazine.

[221]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[222]  Wendi Heinzelman,et al.  Energy-efficient communication protocol for wireless microsensor networks , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[223]  Qi Hao,et al.  Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.

[224]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[225]  Geoffrey Ye Li,et al.  Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems , 2017, IEEE Wireless Communications Letters.

[226]  Clayton W. Commander,et al.  Broadcast Scheduling Problem , 2009, Encyclopedia of Optimization.

[227]  N. Sundararajan,et al.  Communication channel equalisation using minimal radial basis function neural networks , 1998, Neural Networks for Signal Processing VIII. Proceedings of the 1998 IEEE Signal Processing Society Workshop (Cat. No.98TH8378).

[228]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[229]  Ana Isabel Pérez Neira,et al.  Hybrid analog-digital transmit beamforming for spectrum sharing backhaul networks , 2018 .

[230]  Yann LeCun PhD thesis: Modeles connexionnistes de l'apprentissage (connectionist learning models) , 1987 .

[231]  L. Buydens,et al.  Facilitating the application of Support Vector Regression by using a universal Pearson VII function based kernel , 2006 .

[232]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[233]  Yu-Dong Yao,et al.  Modulation classification using convolutional Neural Network based deep learning model , 2017, 2017 26th Wireless and Optical Communication Conference (WOCC).

[234]  D. P. Taylor,et al.  On the application of feed forward neural networks to channel equalization , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[235]  Kwang-Cheng Chen,et al.  Carrier Sensing Based Multiple Access Protocols for Cognitive Radio Networks , 2008, 2008 IEEE International Conference on Communications.

[236]  R. Ranjan,et al.  Reinforcement learning for dynamic channel allocation in mobile cellular systems , 2008, 2008 International Conference on Recent Advances in Microwave Theory and Applications.

[237]  Anis Laouiti,et al.  TDMA-Based MAC Protocols for Vehicular Ad Hoc Networks: A Survey, Qualitative Analysis, and Open Research Issues , 2015, IEEE Communications Surveys & Tutorials.

[238]  Timothy J. O'Shea,et al.  Deep architectures for modulation recognition , 2017, 2017 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[239]  Nirwan Ansari,et al.  Optimal Broadcast Scheduling in Packet Radio Networks Using Mean Field Annealing , 1997, IEEE J. Sel. Areas Commun..

[240]  Kenneth N. Brown,et al.  ER-MAC: A Hybrid MAC Protocol for Emergency Response Wireless Sensor Networks , 2010, 2010 Fourth International Conference on Sensor Technologies and Applications.

[241]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[242]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[243]  Myung-Sup Kim,et al.  Linear SVM-Based Android Malware Detection for Reliable IoT Services , 2014, J. Appl. Math..

[244]  Brad Karp,et al.  GPSR : Greedy Perimeter Stateless Routing for Wireless , 2000, MobiCom 2000.

[245]  Kareem E. Baddour,et al.  Spectrum Occupancy Prediction for Land Mobile Radio Bands Using a Recommender System , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[246]  Anu Jagannath,et al.  Artificial Intelligence-based Cognitive Cross-layer Decision Engine for Next-Generation Space Mission , 2019, 2019 IEEE Cognitive Communications for Aerospace Applications Workshop (CCAAW).

[247]  Roy D. Yates,et al.  Constrained power control , 1994, Wirel. Pers. Commun..

[248]  Fadi Al-Turjman,et al.  Analysis of Cross-Layer Design of Quality-of-Service Forward Geographic Wireless Sensor Network Routing Strategies in Green Internet of Things , 2018, IEEE Access.

[249]  Xiaolei Ma,et al.  Mining smart card data for transit riders’ travel patterns , 2013 .

[250]  Andrew L. Drozd,et al.  Framework for automatic signal classification techniques (FACT) for software defined radios , 2015, 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA).

[251]  Amir Masoud Rahmani,et al.  A hybrid QoS multicast framework-based protocol for wireless mesh networks , 2010, Comput. Commun..

[252]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .