Deep learning architectures in emerging cloud computing architectures: Recent development, challenges and next research trend

Abstract The challenges of the conventional cloud computing paradigms motivated the emergence of the next generation cloud computing architectures. The emerging cloud computing architectures generate voluminous amount of data that are beyond the capability of the shallow intelligent algorithms to process. Deep learning algorithms, with their ability to process large-scale datasets, have recently started gaining tremendous attentions from researchers to solve problem in the emerging cloud computing architectures. However, no comprehensive literature review exists on the applications of deep learning architectures to solve complex problems in emerging cloud computing architectures. To fill this gap, we conducted a comprehensive literature survey on the applications of deep learning architectures in emerging cloud computing architectures. The survey shows that the adoption of deep learning architectures in emerging cloud computing architectures are increasingly becoming an interesting research area. We introduce a new taxonomy of deep learning architectures for emerging cloud computing architectures and provide deep insights into the current state-of-the-art active research works on deep learning to solve complex problems in emerging cloud computing architectures. The synthesis and analysis of the articles as well as their limitation are presented. A lot of challenges were identified in the literature and new future research directions to solve the identified challenges are presented. We believed that this article can serve as a reference guide to new researchers and an update for expert researchers to explore and develop more deep learning applications in the emerging cloud computing architectures.

[1]  Haruna Chiroma,et al.  A Theoretical Framework for Big Data Analytics Based on Computational Intelligent Algorithms with the Potential to Reduce Energy Consumption , 2019, Advances on Computational Intelligence in Energy.

[2]  Qun Li,et al.  Fog Computing: Platform and Applications , 2015, 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb).

[3]  Ronghua Xu,et al.  Real-Time Human Detection as an Edge Service Enabled by a Lightweight CNN , 2018, 2018 IEEE International Conference on Edge Computing (EDGE).

[4]  Dirk Schaefer,et al.  Software-defined cloud manufacturing for industry 4.0 , 2016 .

[5]  Chengfeng Jian,et al.  An Improved Chaotic Bat Swarm Scheduling Learning Model on Edge Computing , 2019, IEEE Access.

[6]  Juan M. Corchado,et al.  A review of edge computing reference architectures and a new global edge proposal , 2019, Future Gener. Comput. Syst..

[7]  Juan M. Corchado,et al.  Cloud Computing and Multiagent Systems, a Promising Relationship , 2016 .

[8]  Jason P. Jue,et al.  All One Needs to Know about Fog Computing and Related Edge Computing Paradigms , 2019 .

[9]  Xukan Ran,et al.  Deep Learning With Edge Computing: A Review , 2019, Proceedings of the IEEE.

[10]  HuPengfei,et al.  Survey on fog computing , 2017 .

[11]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[12]  Yanyi Rao,et al.  Deep Learning-Based Channel Prediction for Edge Computing Networks Toward Intelligent Connected Vehicles , 2019, IEEE Access.

[13]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[14]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[15]  Ying Zhang,et al.  Batch normalized recurrent neural networks , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[17]  Philip S. Yu,et al.  Distributed Deep Learning Model for Intelligent Video Surveillance Systems with Edge Computing , 2019, IEEE Transactions on Industrial Informatics.

[18]  Al-AyyoubMahmoud,et al.  Software defined cloud , 2016 .

[19]  Dejan S. Milojicic,et al.  A Manifesto for Future Generation Cloud Computing: Research Directions for the Next Decade , 2018 .

[20]  Rodrigo Roman,et al.  Mobile Edge Computing, Fog et al.: A Survey and Analysis of Security Threats and Challenges , 2016, Future Gener. Comput. Syst..

[21]  Ke Zhang,et al.  Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics , 2019, IEEE Internet of Things Journal.

[22]  Soumya Kanti Datta,et al.  Comparison of edge computing implementations: Fog computing, cloudlet and mobile edge computing , 2017, 2017 Global Internet of Things Summit (GIoTS).

[23]  Rajkumar Buyya,et al.  SDCon: Integrated Control Platform for Software-Defined Clouds , 2019, IEEE Transactions on Parallel and Distributed Systems.

[24]  Pan Zheng,et al.  An Improved Convolutional Network Architecture Based on Residual Modeling for Person Re-Identification in Edge Computing , 2019, IEEE Access.

[25]  Yan Zhang,et al.  Deep Learning for Secure Mobile Edge Computing in Cyber-Physical Transportation Systems , 2019, IEEE Network.

[26]  Tie Qiu,et al.  Survey on fog computing: architecture, key technologies, applications and open issues , 2017, J. Netw. Comput. Appl..

[27]  Michael Dahlin,et al.  Volunteer Cloud Computing: MapReduce over the Internet , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[28]  Lei Guo,et al.  Deep Reinforcement Learning for Intelligent Internet of Vehicles: An Energy-Efficient Computational Offloading Scheme , 2019, IEEE Transactions on Cognitive Communications and Networking.

[29]  Nasser Yazdani,et al.  Performability analysis of cloudlet in mobile cloud computing , 2017, Inf. Sci..

[30]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[31]  Mianxiong Dong,et al.  Deep Learning for Smart Industry: Efficient Manufacture Inspection System With Fog Computing , 2018, IEEE Transactions on Industrial Informatics.

[32]  Jemal H. Abawajy,et al.  Privacy-preserving multi-hop profile-matching protocol for proximity mobile social networks , 2017, Future Gener. Comput. Syst..

[33]  Bing Chen,et al.  Data Security and Privacy-Preserving in Edge Computing Paradigm: Survey and Open Issues , 2018, IEEE Access.

[34]  Zdenek Becvar,et al.  Mobile Edge Computing: A Survey on Architecture and Computation Offloading , 2017, IEEE Communications Surveys & Tutorials.

[35]  T. V. Lakshman,et al.  Enhancing Mobile Networks With Software Defined Networking and Cloud Computing , 2017, IEEE/ACM Transactions on Networking.

[36]  Mahmoud Al-Ayyoub,et al.  Software defined cloud: Survey, system and evaluation , 2016, Future Gener. Comput. Syst..

[37]  BuyyaRajkumar,et al.  Next generation cloud computing , 2018 .

[38]  Jiamin Lu,et al.  Urban Street Cleanliness Assessment Using Mobile Edge Computing and Deep Learning , 2019, IEEE Access.

[39]  Adamu I. Abubakar,et al.  Progress on Artificial Neural Networks for Big Data Analytics: A Survey , 2019, IEEE Access.

[40]  Ladislav Hluchý,et al.  Machine Learning and Deep Learning frameworks and libraries for large-scale data mining: a survey , 2019, Artificial Intelligence Review.

[41]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[42]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[43]  Katrina E. Falkner,et al.  A systematic review on literature-based discovery workflow , 2019, PeerJ Comput. Sci..

[44]  Yuan Wu,et al.  Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing , 2019, Digit. Commun. Networks.

[45]  Sateesh Addepalli,et al.  Fog computing and its role in the internet of things , 2012, MCC '12.

[46]  Ekasit Kijsipongse,et al.  A hybrid GPU cluster and volunteer computing platform for scalable deep learning , 2018, The Journal of Supercomputing.

[47]  Jemal H. Abawajy,et al.  Adaptive Computing-Plus-Communication Optimization Framework for Multimedia Processing in Cloud Systems , 2020, IEEE Transactions on Cloud Computing.

[48]  Qingqi Pei,et al.  Privacy-Preserving Compressive Model for Enhanced Deep-Learning-Based Service Provision System in Edge Computing , 2019, IEEE Access.

[49]  Keqin Li,et al.  Minimizing SLA violation and power consumption in Cloud data centers using adaptive energy-aware algorithms , 2017, Future Gener. Comput. Syst..

[50]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[51]  Sihai Zhang,et al.  Mobile Edge Computing-Based Data-Driven Deep Learning Framework for Anomaly Detection , 2019, IEEE Access.

[52]  Haleem Farman,et al.  Deep Learning Methods and Applications , 2018, Deep Learning: Convergence to Big Data Analytics.

[53]  M. Arif Wani,et al.  Advances in Deep Learning , 2020 .

[54]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[55]  Wei Yu,et al.  A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends , 2018, IEEE Access.

[56]  Guang Yang,et al.  SaliencyGAN: Deep Learning Semisupervised Salient Object Detection in the Fog of IoT , 2020, IEEE Transactions on Industrial Informatics.

[57]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[58]  Mazliza Othman,et al.  A Survey of Mobile Cloud Computing Application Models , 2014, IEEE Communications Surveys & Tutorials.

[59]  Atay Ozgovde,et al.  How Can Edge Computing Benefit From Software-Defined Networking: A Survey, Use Cases, and Future Directions , 2017, IEEE Communications Surveys & Tutorials.

[60]  Anthony T. Chronopoulos,et al.  Software-Defined Cloud Computing: A Systematic Review on Latest Trends and Developments , 2019, IEEE Access.

[61]  Zhaoyu Li,et al.  New Deep Learning Methods for Protein Loop Modeling , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[62]  M. Shamim Hossain,et al.  Improving consumer satisfaction in smart cities using edge computing and caching: A case study of date fruits classification , 2018, Future Gener. Comput. Syst..

[63]  Paul R. Brenner,et al.  Serverless Computing: Design, Implementation, and Performance , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[64]  Laurence T. Yang,et al.  A Double Deep Q-Learning Model for Energy-Efficient Edge Scheduling , 2019, IEEE Transactions on Services Computing.

[65]  Enzo Baccarelli,et al.  Fog of Everything: Energy-Efficient Networked Computing Architectures, Research Challenges, and a Case Study , 2017, IEEE Access.

[66]  Rajkumar Buyya,et al.  Next generation cloud computing: New trends and research directions , 2017, Future Gener. Comput. Syst..

[67]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[68]  Xiangjian He,et al.  UrbanEdge: deep learning empowered edge computing for urban IoT time series prediction , 2019, ACM TUR-C.

[69]  Mianxiong Dong,et al.  Deep Reinforcement Scheduling for Mobile Crowdsensing in Fog Computing , 2019, ACM Trans. Internet Techn..

[70]  Feng Xia,et al.  Cloudlet deployment in local wireless networks: Motivation, architectures, applications, and open challenges , 2016, J. Netw. Comput. Appl..

[71]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[72]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[73]  Dunren Che,et al.  Survey and Taxonomy of Volunteer Computing , 2019, ACM Comput. Surv..

[74]  Paramvir Bahl,et al.  The Case for VM-Based Cloudlets in Mobile Computing , 2009, IEEE Pervasive Computing.

[75]  Pasi Liljeberg,et al.  Empowering Healthcare IoT Systems with Hierarchical Edge-Based Deep Learning , 2018, 2018 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[76]  Biao Yang,et al.  Edge computing-based real-time passenger counting using a compact convolutional neural network , 2018, Neural Computing and Applications.

[77]  Naveen K. Chilamkurti,et al.  Distributed attack detection scheme using deep learning approach for Internet of Things , 2017, Future Gener. Comput. Syst..

[78]  Cheng Zhang,et al.  Task migration for mobile edge computing using deep reinforcement learning , 2019, Future Gener. Comput. Syst..

[79]  Arun Kumar Sangaiah,et al.  Intelligent sentiment analysis approach using edge computing‐based deep learning technique , 2020, Softw. Pract. Exp..

[80]  Mark J. F. Gales,et al.  Improving the interpretability of deep neural networks with stimulated learning , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[81]  Alfonso Reginelli,et al.  Artificial intelligence to codify lung CT in Covid-19 patients , 2020, La radiologia medica.