Deep Learning for IoT Big Data and Streaming Analytics: A Survey

In the era of the Internet of Things (IoT), an enormous amount of sensing devices collect and/or generate various sensory data over time for a wide range of fields and applications. Based on the nature of the application, these devices will result in big or fast/real-time data streams. Applying analytics over such data streams to discover new information, predict future insights, and make control decisions is a crucial process that makes IoT a worthy paradigm for businesses and a quality-of-life improving technology. In this paper, we provide a thorough overview on using a class of advanced machine learning techniques, namely deep learning (DL), to facilitate the analytics and learning in the IoT domain. We start by articulating IoT data characteristics and identifying two major treatments for IoT data from a machine learning perspective, namely IoT big data analytics and IoT streaming data analytics. We also discuss why DL is a promising approach to achieve the desired analytics in these types of data and applications. The potential of using emerging DL techniques for IoT data analytics are then discussed, and its promises and challenges are introduced. We present a comprehensive background on different DL architectures and algorithms. We also analyze and summarize major reported research attempts that leveraged DL in the IoT domain. The smart IoT devices that have incorporated DL in their intelligence background are also discussed. DL implementation approaches on the fog and cloud centers in support of IoT applications are also surveyed. Finally, we shed light on some challenges and potential directions for future research. At the end of each section, we highlight the lessons learned based on our experiments and review of the recent literature.

[1]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[2]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[3]  Wei Fan,et al.  Mining big data: current status, and forecast to the future , 2013, SKDD.

[4]  Kenneth Kreutz-Delgado,et al.  ApproxDBN: Approximate Computing for Discriminative Deep Belief Networks , 2017, ArXiv.

[5]  Chunyan Miao,et al.  Online multimodal deep similarity learning with application to image retrieval , 2013, ACM Multimedia.

[6]  Daniel Svozil,et al.  Introduction to multi-layer feed-forward neural networks , 1997 .

[7]  Kaushik Roy,et al.  SPINDLE: SPINtronic Deep Learning Engine for large-scale neuromorphic computing , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[8]  Christian Szegedy,et al.  DeepPose: Human Pose Estimation via Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Curt H. Davis,et al.  Fusion of Deep Convolutional Neural Networks for Land Cover Classification of High-Resolution Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Ming Liu,et al.  Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why not , 2016, ArXiv.

[11]  Marianne Winslett,et al.  Mercury: Metro density prediction with recurrent neural network on streaming CDR data , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[12]  Luca Benini,et al.  Brain-Inspired Classroom Occupancy Monitoring on a Low-Power Mobile Platform , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[14]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Matthias Becker.  Indoor Positioning Solely Based on User's Sight , 2017, ICISA.

[17]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[18]  Lam-for Kwok,et al.  A vision for the development of i-campus , 2015, Smart Learning Environments.

[19]  Gang Chen,et al.  Sequential Labeling with Online Deep Learning: Exploring Model Initialization , 2016, ECML/PKDD.

[20]  Laurence T. Yang,et al.  Data Mining for Internet of Things: A Survey , 2014, IEEE Communications Surveys & Tutorials.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Hyeran Byun,et al.  Real-time traffic sign recognition based on a general purpose GPU and deep-learning , 2017, PloS one.

[23]  Kaushik Roy,et al.  AxNN: Energy-efficient neuromorphic systems using approximate computing , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[24]  Qiang Wang,et al.  Benchmarking State-of-the-Art Deep Learning Software Tools , 2016, 2016 7th International Conference on Cloud Computing and Big Data (CCBD).

[25]  Yanlei Gu,et al.  Joint Customer Pose and Orientation Estimation Using Deep Neural Network from Surveillance Camera , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Kavita Bala,et al.  Learning visual similarity for product design with convolutional neural networks , 2015, ACM Trans. Graph..

[28]  Yu Wang,et al.  Towards Real-Time Object Detection on Embedded Systems , 2018, IEEE Transactions on Emerging Topics in Computing.

[29]  Muhammad Ghulam,et al.  Smart Health Solution Integrating IoT and Cloud: A Case Study of Voice Pathology Monitoring , 2017, IEEE Communications Magazine.

[30]  Srinath Perera,et al.  Big Data Analytics Platforms for Real-Time Applications in IoT , 2016 .

[31]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[32]  Nicholas D. Lane,et al.  DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[33]  David A. Patterson,et al.  In-datacenter performance analysis of a tensor processing unit , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[34]  Ying Liu,et al.  Geological Disaster Recognition on Optical Remote Sensing Images Using Deep Learning , 2016 .

[35]  Rich Caruana,et al.  Do Deep Nets Really Need to be Deep? , 2013, NIPS.

[36]  Carlo Meghini,et al.  Deep learning for decentralized parking lot occupancy detection , 2017, Expert Syst. Appl..

[37]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[38]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[39]  Hwee Pink Tan,et al.  Mobile big data analytics using deep learning and apache spark , 2016, IEEE Network.

[40]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[41]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Saad B. Qaisar,et al.  Fog Networking for Machine Health Prognosis: A Deep Learning Perspective , 2017, ICCSA.

[43]  Davy Preuveneers,et al.  CEML: Mixing and moving complex event processing and machine learning to the edge of the network for IoT applications , 2016, IOT.

[44]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[45]  Luo Xiao,et al.  Exact clothing retrieval approach based on deep neural network , 2016, 2016 IEEE Information Technology, Networking, Electronic and Automation Control Conference.

[46]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[47]  Qihui Wu,et al.  A survey of machine learning for big data processing , 2016, EURASIP Journal on Advances in Signal Processing.

[48]  Junaid Qadir,et al.  Neural networks in wireless networks: Techniques, applications and guidelines , 2016, J. Netw. Comput. Appl..

[49]  Ala I. Al-Fuqaha,et al.  Enabling Cognitive Smart Cities Using Big Data and Machine Learning: Approaches and Challenges , 2018, IEEE Communications Magazine.

[50]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[51]  Yifan Guo,et al.  Earthquake Prediction Based on Spatio-Temporal Data Mining: An LSTM Network Approach , 2020, IEEE Transactions on Emerging Topics in Computing.

[52]  Raymond H. Putra,et al.  A Deep-Learning Approach for Operation of an Automated Realtime Flare Forecast , 2016, ArXiv.

[53]  Trishul M. Chilimbi,et al.  Project Adam: Building an Efficient and Scalable Deep Learning Training System , 2014, OSDI.

[54]  Misha Denil,et al.  Predicting Parameters in Deep Learning , 2014 .

[55]  Xuan Song,et al.  DeepTransport: Prediction and Simulation of Human Mobility and Transportation Mode at a Citywide Level , 2016, IJCAI.

[56]  Ninghui Sun,et al.  DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning , 2014, ASPLOS.

[57]  Song Han,et al.  Learning both Weights and Connections for Efficient Neural Network , 2015, NIPS.

[58]  Jin Wei,et al.  Real-Time Detection of False Data Injection Attacks in Smart Grid: A Deep Learning-Based Intelligent Mechanism , 2017, IEEE Transactions on Smart Grid.

[59]  Issa M. Khalil,et al.  Online Auction of Cloud Resources in Support of the Internet of Things , 2017, IEEE Internet of Things Journal.

[60]  Tao Wang,et al.  Deep learning with COTS HPC systems , 2013, ICML.

[61]  Nicholas D. Lane,et al.  An Early Resource Characterization of Deep Learning on Wearables, Smartphones and Internet-of-Things Devices , 2015, IoT-App@SenSys.

[62]  Carlos Delgado Kloos,et al.  Experimenting with electromagnetism using augmented reality: Impact on flow student experience and educational effectiveness , 2014, Comput. Educ..

[63]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[64]  Tristan Perez,et al.  DeepFruits: A Fruit Detection System Using Deep Neural Networks , 2016, Sensors.

[65]  John Gantz,et al.  The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East , 2012 .

[66]  Alex Fridman,et al.  Learning Human Identity from Motion Patterns , 2015, IEEE Access.

[67]  Song Han,et al.  EIE: Efficient Inference Engine on Compressed Deep Neural Network , 2016, 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA).

[68]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[69]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[70]  Guang-Zhong Yang,et al.  A Deep Learning Approach to on-Node Sensor Data Analytics for Mobile or Wearable Devices , 2017, IEEE Journal of Biomedical and Health Informatics.

[71]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[72]  Vitaly Shmatikov,et al.  Privacy-preserving deep learning , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[73]  Premkumar T. Devanbu,et al.  Are deep neural networks the best choice for modeling source code? , 2017, ESEC/SIGSOFT FSE.

[74]  Yonggang Wen,et al.  Toward Scalable Systems for Big Data Analytics: A Technology Tutorial , 2014, IEEE Access.

[75]  Eleni Stroulia,et al.  Parking-stall vacancy indicator system, based on deep convolutional neural networks , 2016, 2016 IEEE 3rd World Forum on Internet of Things (WF-IoT).

[76]  KimJong-Min,et al.  A load balancing scheme based on deep-learning in IoT , 2017 .

[77]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[78]  Geoffrey C. Fox,et al.  Real-Time, Cloud-Based Object Detection for Unmanned Aerial Vehicles , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[79]  Bernhard Sick,et al.  Deep Learning for solar power forecasting — An approach using AutoEncoder and LSTM Neural Networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[80]  Weizhong Yan,et al.  On Accurate and Reliable Anomaly Detection for Gas Turbine Combustors: A Deep Learning Approach , 2015, Annual Conference of the PHM Society.

[81]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.

[82]  Mung Chiang,et al.  Behavior-Based Grade Prediction for MOOCs Via Time Series Neural Networks , 2017, IEEE Journal of Selected Topics in Signal Processing.

[83]  Dawei Li,et al.  DeepCham: Collaborative Edge-Mediated Adaptive Deep Learning for Mobile Object Recognition , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[84]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[85]  Ian Goodfellow,et al.  Deep Learning with Differential Privacy , 2016, CCS.

[86]  Holger Ziekow,et al.  Towards a Big Data Analytics Framework for IoT and Smart City Applications , 2015 .

[87]  Ryosuke Shibasaki,et al.  Estimating crop yields with deep learning and remotely sensed data , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[88]  Harri Valpola,et al.  From neural PCA to deep unsupervised learning , 2014, ArXiv.

[89]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[90]  Wolfram Burgard,et al.  A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to Imitation , 2016 .

[91]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[92]  M. Hilbert,et al.  Big Data for Development: A Review of Promises and Challenges , 2016 .

[93]  Chang Ouk Kim,et al.  A Deep Learning Model for Robust Wafer Fault Monitoring With Sensor Measurement Noise , 2017, IEEE Transactions on Semiconductor Manufacturing.

[94]  Tom M. Mitchell,et al.  What can machine learning do? Workforce implications , 2017, Science.

[95]  Ran El-Yaniv,et al.  Binarized Neural Networks , 2016, NIPS.

[96]  Yan Chen,et al.  Intelligent 5G: When Cellular Networks Meet Artificial Intelligence , 2017, IEEE Wireless Communications.

[97]  Li Pan,et al.  Predicting Short-Term Traffic Flow by Long Short-Term Memory Recurrent Neural Network , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[98]  Curt H. Davis,et al.  Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[99]  Svetlana Lazebnik,et al.  Where to Buy It: Matching Street Clothing Photos in Online Shops , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[100]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[101]  Hao Jiang,et al.  An online sequential extreme learning machine approach to WiFi based indoor positioning , 2014, 2014 IEEE World Forum on Internet of Things (WF-IoT).

[102]  André Luckow,et al.  2016 Ieee International Conference on Big Data (big Data) Deep Learning in the Automotive Industry: Applications and Tools , 2022 .

[103]  Scott Shenker,et al.  Fast and Interactive Analytics over Hadoop Data with Spark , 2012, login Usenix Mag..

[104]  Prashant J. Shenoy,et al.  Supporting Scalable Analytics with Latency Constraints , 2015, Proc. VLDB Endow..

[105]  Qi Shi,et al.  A Deep Learning Approach to Network Intrusion Detection , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[106]  Greg Mori,et al.  A Hierarchical Deep Temporal Model for Group Activity Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[107]  Sander Dieleman,et al.  Beyond Temporal Pooling: Recurrence and Temporal Convolutions for Gesture Recognition in Video , 2015, International Journal of Computer Vision.

[108]  Xiang Li,et al.  Deep learning architecture for air quality predictions , 2016, Environmental Science and Pollution Research.

[109]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[110]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[111]  Gang Li,et al.  Big data related technologies, challenges and future prospects , 2015, J. Inf. Technol. Tour..

[112]  Dusit Niyato,et al.  Random access for machine-to-machine communication in LTE-advanced networks: issues and approaches , 2013, IEEE Communications Magazine.

[113]  J. Manyika,et al.  Disruptive technologies: Advances that will transform life, business, and the global economy , 2013 .

[114]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[115]  Zhenlong Yuan,et al.  Droid-Sec: deep learning in android malware detection , 2015, SIGCOMM 2015.

[116]  David Blaauw,et al.  14.7 A 288µW programmable deep-learning processor with 270KB on-chip weight storage using non-uniform memory hierarchy for mobile intelligence , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[117]  Xin-She Yang,et al.  Convolutional Neural Networks Applied for Parkinson's Disease Identification , 2016, Machine Learning for Health Informatics.

[118]  Jitendra Malik,et al.  Recurrent Network Models for Human Dynamics , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[119]  Yoshihide Sekimoto,et al.  Lightweight road manager: smartphone-based automatic determination of road damage status by deep neural network , 2016, MobiGIS.

[120]  Andra Lutu,et al.  ZipWeave: Towards efficient and reliable measurement based mobile coverage maps , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[121]  Christopher Joseph Pal,et al.  EmoNets: Multimodal deep learning approaches for emotion recognition in video , 2015, Journal on Multimodal User Interfaces.

[122]  Mohak Shah,et al.  Comparative Study of Deep Learning Software Frameworks , 2015, 1511.06435.

[123]  Katherine Bourzac.  Speck-size computers: Now with deep learning [News] , 2017 .

[124]  Kaushik Roy,et al.  Efficient embedded learning for IoT devices , 2016, 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC).

[125]  Yakup Genc,et al.  Applying Deep Learning in Augmented Reality Tracking , 2016, 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[126]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[127]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[128]  Yixin Chen,et al.  Compressing Neural Networks with the Hashing Trick , 2015, ICML.

[129]  Edwin Olson,et al.  Learning semantic place labels from occupancy grids using CNNs , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[130]  Uwe Meier,et al.  Wireless interference identification with convolutional neural networks , 2017, 2017 IEEE 15th International Conference on Industrial Informatics (INDIN).

[131]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[132]  Rashid Mehmood,et al.  UTiLearn: A Personalised Ubiquitous Teaching and Learning System for Smart Societies , 2017, IEEE Access.

[133]  Chao Li,et al.  Anomaly detection of spectrum in wireless communication via deep auto-encoders , 2017, The Journal of Supercomputing.

[134]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[135]  Suk-Ho Lee,et al.  3D Integral Imaging Based Augmented Reality with Deep Learning Implemented by Faster R-CNN , 2017 .

[136]  Jianwu Dang,et al.  Multimodal sensory fusion for soccer robot self-localization based on long short-term memory recurrent neural network , 2017, J. Ambient Intell. Humaniz. Comput..

[137]  Mohsen Guizani,et al.  Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services , 2018, IEEE Internet of Things Journal.

[138]  Leonidas J. Guibas,et al.  Deep Knowledge Tracing , 2015, NIPS.

[139]  Ming Liu,et al.  A deep-network solution towards model-less obstacle avoidance , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[140]  Mohsen Guizani,et al.  Toward better horizontal integration among IoT services , 2015, IEEE Communications Magazine.

[141]  Benjamin Schrauwen,et al.  Training and Analysing Deep Recurrent Neural Networks , 2013, NIPS.

[142]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[143]  Kenta Oono,et al.  Chainer : a Next-Generation Open Source Framework for Deep Learning , 2015 .

[144]  Je-Won Kang,et al.  Intrusion Detection System Using Deep Neural Network for In-Vehicle Network Security , 2016, PloS one.

[145]  Luming Zhang,et al.  Fusion of Magnetic and Visual Sensors for Indoor Localization: Infrastructure-Free and More Effective , 2017, IEEE Transactions on Multimedia.

[146]  Michael E. Flatté,et al.  Challenges for semiconductor spintronics , 2007 .

[147]  Sanja Fidler,et al.  Towards Diverse and Natural Image Descriptions via a Conditional GAN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[148]  Miao Yu,et al.  Deep learning for posture analysis in fall detection , 2014, 2014 19th International Conference on Digital Signal Processing.

[149]  Boris Murmann,et al.  Cognitive computation and communication: A complement solution to cloud for IoT , 2016, 2016 International Conference on Advanced Technologies for Communications (ATC).

[150]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[151]  Wu Liu,et al.  Deep Learning Based Intelligent Basketball Arena with Energy Image , 2017, MMM.

[152]  Li Deng,et al.  A tutorial survey of architectures, algorithms, and applications for deep learning , 2014, APSIPA Transactions on Signal and Information Processing.

[153]  Prabhat,et al.  Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets , 2016, ArXiv.

[154]  Andreas Leven,et al.  Applying Neural Networks in Optical Communication Systems: Possible Pitfalls , 2017, IEEE Photonics Technology Letters.

[155]  Yiqiang Chen,et al.  Semi-supervised deep extreme learning machine for Wi-Fi based localization , 2015, Neurocomputing.

[156]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[157]  Scott Shenker,et al.  Shark: fast data analysis using coarse-grained distributed memory , 2012, SIGMOD Conference.

[158]  Antonio Liotta,et al.  Big IoT data mining for real-time energy disaggregation in buildings , 2017, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[159]  Zhitang Chen,et al.  Online Algorithms for Sum-Product Networks with Continuous Variables , 2016, Probabilistic Graphical Models.

[160]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[161]  Haidong Shao,et al.  An enhancement deep feature fusion method for rotating machinery fault diagnosis , 2017, Knowl. Based Syst..

[162]  Cees T. A. M. de Laat,et al.  Addressing big data issues in Scientific Data Infrastructure , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[163]  Bo Tang,et al.  Incorporating Intelligence in Fog Computing for Big Data Analysis in Smart Cities , 2017, IEEE Transactions on Industrial Informatics.

[164]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[165]  Ananthram Swami,et al.  The Limitations of Deep Learning in Adversarial Settings , 2015, 2016 IEEE European Symposium on Security and Privacy (EuroS&P).

[166]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[167]  Milos Manic,et al.  Intelligent Buildings of the Future: Cyberaware, Deep Learning Powered, and Human Interacting , 2016, IEEE Industrial Electronics Magazine.

[168]  Ming Shao,et al.  A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[169]  James R. Glass,et al.  14.4 A scalable speech recognizer with deep-neural-network acoustic models and voice-activated power gating , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[170]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[171]  Marc'Aurelio Ranzato,et al.  Learning Longer Memory in Recurrent Neural Networks , 2014, ICLR.

[172]  Richard Demo Souza,et al.  A Survey of Machine Learning Techniques Applied to Self-Organizing Cellular Networks , 2017, IEEE Communications Surveys & Tutorials.

[173]  R. Zemel,et al.  Classifying NBA Offensive Plays Using Neural Networks , 2016 .

[174]  Gaurav Mittal,et al.  SpotGarbage: smartphone app to detect garbage using deep learning , 2016, UbiComp.

[175]  Julius Hannink,et al.  Activity recognition in beach volleyball using a Deep Convolutional Neural Network , 2017, Data Mining and Knowledge Discovery.

[176]  Darko Stefanovic,et al.  Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification , 2016, Comput. Intell. Neurosci..

[177]  Marian Verhelst,et al.  Energy-efficient ConvNets through approximate computing , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[178]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[179]  Carl Doersch,et al.  Tutorial on Variational Autoencoders , 2016, ArXiv.

[180]  Yunpeng Wang,et al.  Large-Scale Transportation Network Congestion Evolution Prediction Using Deep Learning Theory , 2015, PloS one.

[181]  Ivan Marsic,et al.  Deep Learning for RFID-Based Activity Recognition , 2016, SenSys.

[182]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[183]  Rajiv Shah,et al.  Applying Deep Learning to Basketball Trajectories , 2016, ArXiv.

[184]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[185]  Jaime Lloret,et al.  Conditional Variational Autoencoder for Prediction and Feature Recovery Applied to Intrusion Detection in IoT , 2017, Sensors.

[186]  Vinod Vokkarane,et al.  A New Deep Learning-Based Food Recognition System for Dietary Assessment on An Edge Computing Service Infrastructure , 2018, IEEE Transactions on Services Computing.

[187]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[188]  Yonggang Wen,et al.  Multicolumn Bidirectional Long Short-Term Memory for Mobile Devices-Based Human Activity Recognition , 2016, IEEE Internet of Things Journal.

[189]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[190]  Lei Chen,et al.  RFID-enabled indoor positioning method for a real-time manufacturing execution system using OS-ELM , 2016, Neurocomputing.

[191]  Jason Jianjun Gu,et al.  Deep Neural Networks for wireless localization in indoor and outdoor environments , 2016, Neurocomputing.

[192]  Marian Verhelst,et al.  A 0.3–2.6 TOPS/W precision-scalable processor for real-time large-scale ConvNets , 2016, 2016 IEEE Symposium on VLSI Circuits (VLSI-Circuits).

[193]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[194]  Narayanan Vijaykrishnan,et al.  A Multitask Grocery Assist System for the Visually Impaired: Smart glasses, gloves, and shopping carts provide auditory and tactile feedback , 2017, IEEE Consumer Electronics Magazine.

[195]  Björn W. Schuller,et al.  Introducing shared-hidden-layer autoencoders for transfer learning and their application in acoustic emotion recognition , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[196]  Hyunsoo Lee,et al.  Framework and development of fault detection classification using IoT device and cloud environment , 2017 .

[197]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[198]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[199]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[200]  Hwee Pink Tan,et al.  Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications , 2014, IEEE Communications Surveys & Tutorials.

[201]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[202]  Nei Kato,et al.  State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems , 2017, IEEE Communications Surveys & Tutorials.

[203]  Christoph Hochreiner,et al.  Predicting Cloud Resource Utilization , 2016, 2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC).

[204]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[205]  E. S. Fennell,et al.  Cat-and-Mouse Game , 1948 .

[206]  Rashid Mehmood,et al.  Data Fusion and IoT for Smart Ubiquitous Environments: A Survey , 2017, IEEE Access.

[207]  Vinod Vokkarane,et al.  DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment , 2016, ICOST.

[208]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[209]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[210]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[211]  Shiwen Mao,et al.  DeepFi: Deep learning for indoor fingerprinting using channel state information , 2015, 2015 IEEE Wireless Communications and Networking Conference (WCNC).

[212]  Peter Christiansen,et al.  Using Deep Learning to Challenge Safety Standard for Highly Autonomous Machines in Agriculture , 2016, J. Imaging.

[213]  Sabee Molloi,et al.  Detecting Cardiovascular Disease from Mammograms With Deep Learning , 2017, IEEE Transactions on Medical Imaging.