Neural networks in wireless networks: Techniques, applications and guidelines

The design of modern wireless networks, which involves decision making and parameter optimization, is quite challenging due to the highly dynamic, and often unknown, environmental conditions that characterize wireless networks. There is a common trend in modern networks to incorporate artificial intelligence (AI) techniques to cope with this design complexity. While a number of AI techniques have been profitably employed in the wireless networks community, the well-established AI framework of neural networks (NNs), well known for their remarkable generality and versatility, has been applied in a wide variety of settings in wireless networks. In particular, NNs are especially popular for tasks involving classification, learning, or optimization. In this paper, we provide both an exposition of common NN models and a comprehensive survey of the applications of NNs in wireless networks. We also identify pitfalls and challenges of implementing NNs especially when we consider alternative AI models and techniques. While various surveys on NNs exist in the literature, our paper is the first paper, to the best of our knowledge, which focuses on the applications of NNs in wireless networks.

[1]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[2]  Yogesh Chaba,et al.  IMPROVING THE PERFORMANCE OF DYNAMIC SOURCE ROUTING PROTOCOL BY OPTIMIZATION OF NEURAL NETWORKS , 2012 .

[3]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[4]  Andrea Zanella,et al.  Cognition-Based Networks: A New Perspective on Network Optimization Using Learning and Distributed Intelligence , 2015, IEEE Access.

[5]  Andrew McCallum,et al.  A comparison of event models for naive bayes text classification , 1998, AAAI 1998.

[6]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[7]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[8]  David Mackay,et al.  Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks , 1995 .

[9]  Marcin Szczuka.  Rough Sets and Artificial Neural Networks , 1998 .

[10]  M. Zorzi,et al.  Learning and Adaptation in Cognitive Radios Using Neural Networks , 2008, 2008 5th IEEE Consumer Communications and Networking Conference.

[11]  Eugenij Moiseevich Mirkes,et al.  Initialization of Self-Organizing Maps: Principal Components Versus Random Initialization. A Case Study , 2012, ArXiv.

[12]  Panagiotis Demestichas,et al.  Performance evaluation of artificial neural network-based learning schemes for cognitive radio systems , 2010, Comput. Electr. Eng..

[13]  Carlos León,et al.  Using artificial intelligence in routing schemes for wireless networks , 2007, Comput. Commun..

[14]  Shuai Li,et al.  Neural network based mobile phone localization using Bluetooth connectivity , 2013, Neural Computing and Applications.

[15]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[16]  Carl J. Debono,et al.  Applying an SOM Neural Network to Increase the Lifetime of Battery-Operated Wireless Sensor Networks , 2010 .

[17]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[18]  Pawan Lingras,et al.  Comparison of Neofuzzy and Rough Neural Networks , 1998, Inf. Sci..

[19]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[20]  Irini Reljin,et al.  Neural network for optimization of routing in communication networks , 2006 .

[21]  Mahesh Motwani,et al.  Survey of clustering algorithms for MANET , 2009, ArXiv.

[22]  Sungyoung Lee,et al.  In-building Localization using Neural Networks , 2006, 2006 IEEE International Conference on Engineering of Intelligent Systems.

[23]  Shahid Khan,et al.  Localization Performance Evaluation of Extended Kalman Filter in Wireless Sensors Network , 2014, ANT/SEIT.

[24]  Stelios Timotheou,et al.  The Random Neural Network: A Survey , 2010, Comput. J..

[25]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[26]  Albert Y. Zomaya,et al.  The use of a Hopfield neural network in solving the mobility management problem , 2004, The IEEE/ACS International Conference onPervasive Services, 2004. ICPS 2004. Proceedings..

[27]  Luca Benini,et al.  Bluetooth indoor localization with multiple neural networks , 2010, IEEE 5th International Symposium on Wireless Pervasive Computing 2010.

[28]  Danco Davcev,et al.  Tracking of unusual events in wireless sensor networks based on artificial neural-networks algorithms , 2005, International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume II.

[29]  Guoqiang Peter Zhang,et al.  Avoiding Pitfalls in Neural Network Research , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[30]  Ian Oppermann,et al.  UWB theory and applications , 2004 .

[31]  Anna Förster.  Machine Learning Techniques Applied to Wireless Ad-Hoc Networks: Guide and Survey , 2007 .

[32]  Wendi Heinzelman,et al.  Energy-efficient communication protocol for wireless microsensor networks , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[33]  Aymen Omri,et al.  Estimation of highly Selective Channels for Downlink LTE MIMO-OFDM System by a Robust Neural Network , 2011, J. Ubiquitous Syst. Pervasive Networks.

[34]  Suyang Ju,et al.  Intelligent Multi-Path Selection Based on Parameters Prediction , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[35]  Saman K. Halgamuge,et al.  An Extended Growing Self-Organizing Map for Selection of Clusters in Sensor Networks , 2005, Int. J. Distributed Sens. Networks.

[36]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[37]  Nirwan Ansari,et al.  Neural Networks in Telecommunications , 1994, Springer US.

[38]  Ladan Darougaran,et al.  Neural networks for error detection and data aggregation in wireless sensor network , 2011 .

[39]  Eleni I. Vlahogianni,et al.  Statistical methods versus neural networks in transportation research: Differences, similarities and some insights , 2011 .

[40]  Dusit Niyato,et al.  A Neural Network Based Spectrum Prediction Scheme for Cognitive Radio , 2010, 2010 IEEE International Conference on Communications.

[41]  Carlos León,et al.  SIR: A New Wireless Sensor Network Routing Protocol Based on Artificial Intelligence , 2006, APWeb Workshops.

[42]  Farouk Kamoun,et al.  Microsoft Word-V1-I1-P95-101 , 2010 .

[43]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[44]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[45]  Virgil Dobrota,et al.  Multipath Routing Management using Neural Networks-Based Traffic Prediction , 2011 .

[46]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Kamalika Chaudhuri,et al.  Location determination of a mobile device using IEEE 802.11b access point signals , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[48]  Floriano De Rango,et al.  A novel passive bandwidth reservation algorithm based on Neural Networks path prediction in wireless environments , 2010, Proceedings of the 2010 International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS '10).

[49]  Zi-Wei Zheng.  Receiver Design for Uplink Multiuser Code Division Multiple Access Communication System Based on Neural Network , 2010, Wirel. Pers. Commun..

[50]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[51]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[52]  Shiang-Chun Liou,et al.  Applied neural network for location prediction and resources reservation scheme in wireless networks , 2003, International Conference on Communication Technology Proceedings, 2003. ICCT 2003..

[53]  Bala Srinivasan,et al.  Dynamic self-organizing maps with controlled growth for knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[54]  Joseph Mitola,et al.  Cognitive Radio Architecture: The Engineering Foundations of Radio XML , 2006 .

[55]  Junita Mohamad-Saleh,et al.  Improved Neural Network Performance Using Principal Component Analysis on Matlab , 2008 .

[56]  Abdel-Badeeh M. Salem,et al.  Improving Self-Organizing Feature Map (SOFM) Training Algorithm Using K-Means Initialization , 2003, ICEIS.

[57]  V. B. Dharmadhikari,et al.  An NN approach for MPEG video traffic prediction , 2010, 2010 2nd International Conference on Software Technology and Engineering.

[58]  Yan Shen,et al.  Wavelet Neural Network Approach for Dynamic Power Management in Wireless Sensor Networks , 2008, 2008 International Conference on Embedded Software and Systems.

[59]  Zhihao Guo,et al.  Delay Prediction for Intelligent Routing in Wireless Networks Using Neural Networks , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[60]  S. Chandramathi,et al.  Intelligent Video QoE Prediction Model for Errorprone Networks , 2015 .

[61]  Wang Ru-chuan,et al.  A Multipath Routing Algorithm Based on Traffic Prediction in Wireless Mesh Networks , 2009, 2009 Fifth International Conference on Natural Computation.

[62]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[63]  Matthias Rychetsky,et al.  Algorithms and architectures for machine learning based on regularized neural netwoks and support vector approaches , 2001 .

[64]  P. Venkateswaran,et al.  Artificial Neural Networks for Cognitive Radio: A Preliminary Survey , 2012, 2012 8th International Conference on Wireless Communications, Networking and Mobile Computing.

[65]  Reza Askari Moghadam,et al.  NEURAL NETWORK BASED ENERGY EFFICIENCY IN WIRELESS SENSOR NETWORKS : A SURVEY , 2010 .

[66]  Irini Reljin,et al.  New algorithm for packet routing in mobile ad-hoc networks , 2010 .

[67]  Rudy Setiono,et al.  Feedforward Neural Network Construction Using Cross Validation , 2001, Neural Computation.

[68]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[69]  R. Chandrasekar,et al.  A Self-organized Agent-based architecture for Power-aware Intrusion Detection in wireless ad-hoc networks , 2006, 2006 International Conference on Computing & Informatics.

[70]  Ian F. Akyildiz,et al.  Wireless sensor networks , 2007 .

[71]  Panagiotis Demestichas,et al.  Neural network-based learning schemes for cognitive radio systems , 2008, Comput. Commun..

[72]  Erkki Mäkinen,et al.  A Neural Network Model to Minimize the Connected Dominating Set for Self-Configuration of Wireless Sensor Networks , 2009, IEEE Transactions on Neural Networks.

[73]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[74]  Georgina Stegmayer,et al.  Neural Networks applied to wireless communications , 2006, IFIP AI.

[75]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[76]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[77]  Joseph Mitola,et al.  Cognitive Radio An Integrated Agent Architecture for Software Defined Radio , 2000 .

[78]  Alan F. Murray,et al.  Confidence estimation methods for neural networks : a practical comparison , 2001, ESANN.

[79]  José M. N. Vieira,et al.  Neuro-Fuzzy Systems: A Survey , 2004 .

[80]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[81]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[82]  R.R. Selmic,et al.  Wireless Sensor Network Modeling Using Modified Recurrent Neural Networks: Application to Fault Detection , 2008, 2007 IEEE International Conference on Networking, Sensing and Control.

[83]  Leonidas J. Guibas,et al.  Localization of mobile users using trajectory matching , 2008, MELT '08.

[84]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[85]  IbnkahlaMohamed.  Applications of neural networks to digital communications , 2000 .

[86]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[87]  Hadi Larijani,et al.  Non-intrusive method for video quality prediction over LTE using random neural networks (RNN) , 2014, 2014 9th International Symposium on Communication Systems, Networks & Digital Sign (CSNDSP).

[88]  Shaya Sheikh,et al.  Mobile ad hoc network proactive routing with delay prediction using neural network , 2010, Wirel. Networks.

[89]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[90]  Michael Egmont-Petersen,et al.  Image processing with neural networks - a review , 2002, Pattern Recognit..

[91]  Indranil Gupta,et al.  Cluster-head election using fuzzy logic for wireless sensor networks , 2005, 3rd Annual Communication Networks and Services Research Conference (CNSR'05).

[92]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[93]  Charles L. Despins,et al.  Indoor Geolocation with Received Signal Strength Fingerprinting Technique and Neural Networks , 2004, ICT.

[94]  Mohamad Musavi,et al.  Localization using neural networks in wireless sensor networks , 2008 .

[95]  Marios M. Polycarpou,et al.  Indoor Localization Using Neural Networks with Location Fingerprints , 2009, ICANN.

[96]  Zdzislaw Pawlak,et al.  Rough Set Theory and its Applications to Data Analysis , 1998, Cybern. Syst..

[97]  Yuichi Nakamura,et al.  Approximation of dynamical systems by continuous time recurrent neural networks , 1993, Neural Networks.

[98]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[99]  Raouf Boutaba,et al.  Mobility Prediction in Wireless Networks using Neural Networks , 2004, MMNS.

[100]  Francine Krief,et al.  Power Control and Clustering in Wireless Sensor Networks , 2005, Med-Hoc-Net.

[101]  Martin D. Buhmann,et al.  Radial Basis Functions , 2021, Encyclopedia of Mathematical Geosciences.

[102]  Ganesh K. Venayagamoorthy,et al.  Neural network based secure media access control protocol for wireless sensor networks , 2009, 2009 International Joint Conference on Neural Networks.

[103]  Rajendra Patrikar,et al.  Improving Life Time of Wireless Sensor Networks Using Neural N etwork Based Classification Techniques With Cooperative Routing , 2008 .

[104]  Miguel Rio,et al.  Internet Traffic Forecasting using Neural Networks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[105]  Roberto Battiti,et al.  Location-aware computing: a neural network model for determining location in wireless LANs , 2002 .

[106]  R. B. Patel,et al.  Neural Network Based Energy Efficient Clustering and Routing in Wireless Sensor Networks , 2009, 2009 First International Conference on Networks & Communications.

[107]  Gerardo Rubino,et al.  A study of real-time packet video quality using random neural networks , 2002, IEEE Trans. Circuits Syst. Video Technol..

[108]  Dong-Chul Park.  Prediction of MPEG Traffic Data Using a Bilinear Recurrent Neural Network with Adaptive Training , 2009, 2009 International Conference on Computer Engineering and Technology.

[109]  Michael R. Berthold,et al.  Constructive training of probabilistic neural networks , 1998, Neurocomputing.

[110]  David Thaler,et al.  Multipath Issues in Unicast and Multicast Next-Hop Selection , 2000, RFC.

[111]  Hong Wang,et al.  Distributed Data Mining Based on Deep Neural Network for Wireless Sensor Network , 2015, Int. J. Distributed Sens. Networks.

[112]  Sofiène Affes,et al.  Neural Networks for Fingerprinting-Based Indoor Localization Using Ultra-Wideband , 2009, J. Commun..

[113]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[114]  Xiaoqiao Meng,et al.  Real-time forest fire detection with wireless sensor networks , 2005, Proceedings. 2005 International Conference on Wireless Communications, Networking and Mobile Computing, 2005..

[115]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[116]  C.J. Debono,et al.  Increasing wireless sensor network lifetime through the application of SOM neural networks , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[117]  Andrew H. Sung,et al.  Intrusion detection using neural networks and support vector machines , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[118]  Philippe Jacquet,et al.  Optimized Link State Routing Protocol (OLSR) , 2003, RFC.

[119]  Joseph B. Evans,et al.  Scalable Cognitive Routing Protocol for Mobile Ad-Hoc Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[120]  Andrea Zanella,et al.  A machine learning approach to QoE-based video admission control and resource allocation in wireless systems , 2014, 2014 13th Annual Mediterranean Ad Hoc Networking Workshop (MED-HOC-NET).

[121]  Ray J. Frank,et al.  Applications of neural networks to telecommunications systems , 1999 .

[122]  Junde Song,et al.  Signal Classification Based on Spectral Correlation Analysis and SVM in Cognitive Radio , 2008, 22nd International Conference on Advanced Information Networking and Applications (aina 2008).

[123]  Panagiotis Demestichas,et al.  Self-Organizing Maps for advanced learning in cognitive radio systems , 2012, Comput. Electr. Eng..

[124]  Hwee Pink Tan,et al.  Efficient data compression with error bound guarantee in wireless sensor networks , 2014, MSWiM '14.

[125]  V. KulkarniR.,et al.  Computational Intelligence in Wireless Sensor Networks , 2011 .

[126]  Berk Üstündag,et al.  A Pattern Construction Scheme for Neural Network-Based Cognitive Communication , 2011, Entropy.

[127]  JINGYUAN ZHANG,et al.  Location management in cellular networks , 2002 .

[128]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[129]  Mohamed Ibnkahla,et al.  Applications of neural networks to digital communications - a survey , 2000, Signal Process..

[130]  Charles E. Perkins,et al.  Ad-hoc on-demand distance vector routing , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[131]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[132]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[133]  Emile H. L. Aarts,et al.  Boltzmann machines , 1998 .

[134]  Danco Davcev,et al.  Application of wavelet neural-networks in wireless sensor networks , 2005, Sixth International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing and First ACIS International Workshop on Self-Assembling Wireless Network.

[135]  Carlo S. Regazzoni,et al.  Use of Time-Frequency Analysis and Neural Networks for Mode Identification in a Wireless Software-Defined Radio Approach , 2004, EURASIP J. Adv. Signal Process..

[136]  A. B. Kahng.  Traveling salesman heuristics and embedding dimension in the Hopfield model , 1989, International 1989 Joint Conference on Neural Networks.

[137]  Syed Ismail Shah,et al.  Impact of Varying Neurons and Hidden Layers in Neural Network Architecture for a Time Frequency Application , 2006, 2006 IEEE International Multitopic Conference.

[138]  Jeffrey H. Reed,et al.  A new approach to signal classification using spectral correlation and neural networks , 2005, First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, 2005. DySPAN 2005..

[139]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[140]  David C. Yen,et al.  Applying data mining to telecom churn management , 2006, Expert Syst. Appl..

[141]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[142]  Simon Haykin,et al.  Neural network-based receiver for wireless communications , 1999 .

[143]  Petri Mähönen,et al.  Neural Wireless Sensor Networks , 2006, 2006 International Conference on Systems and Networks Communications (ICSNC'06).

[144]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[145]  Y. Ho,et al.  Simple Explanation of the No-Free-Lunch Theorem and Its Implications , 2002 .

[146]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[147]  Ganesh K. Venayagamoorthy,et al.  Computational Intelligence in Wireless Sensor Networks: A Survey , 2011, IEEE Communications Surveys & Tutorials.

[148]  Yifeng Zhu,et al.  Localization Using Extended Kalman Filters in Wireless Sensor Networks , 2009 .

[149]  Arvin Agah,et al.  Cognitive engine implementation for wireless multicarrier transceivers , 2007 .

[150]  Kyandoghere Kyamakya,et al.  Location management in cellular networks: classification of the most important paradigms, realistic Simulation framework, and relative performance analysis , 2005, IEEE Transactions on Vehicular Technology.

[151]  Supakit Siripanadorn,et al.  Anomaly detection in wireless sensor networks using self-organizing map and wavelets , 2010 .

[152]  Yan Shen,et al.  Dynamic Power Management based on Wavelet Neural Network in Wireless Sensor Networks , 2007, 2007 IFIP International Conference on Network and Parallel Computing Workshops (NPC 2007).

[153]  Pineda,et al.  Generalization of back-propagation to recurrent neural networks. , 1987, Physical review letters.

[154]  Virgil Dobrota,et al.  Design principles and practical implementation of a Situation Aware Multipath routing algorithm , 2010, SoftCOM 2010, 18th International Conference on Software, Telecommunications and Computer Networks.