Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs

An Intelligent IoT Environment (iIoTe) is comprised of heterogeneous devices that can collaboratively execute semiautonomous IoT applications, examples of which include highly automated manufacturing cells or autonomously interacting harvesting machines. Energy efficiency is key in such edge environments, since they are often based on an infrastructure that consists of wireless and battery-run devices, e.g., e-tractors, drones, Automated Guided Vehicle (AGV)s and robots. The total energy consumption draws contributions from multiple iIoTe technologies that enable edge computing and communication, distributed learning, as well as distributed ledgers and smart contracts. This paper provides a state-of-the-art overview of these technologies and illustrates their functionality and performance, with special attention to the tradeoff among resources, latency, privacy and energy consumption. Finally, the paper provides a vision for integrating these enabling technologies in energyefficient iIoTe and a roadmap to address the open research challenges.

[1]  Sanjeev Jain,et al.  A Survey on Energy Efficient Narrowband Internet of Things (NBIoT): Architecture, Application and Challenges , 2019, IEEE Access.

[2]  Jun Zhao,et al.  Privacy-Preserving Blockchain-Based Federated Learning for IoT Devices , 2019, IEEE Internet of Things Journal.

[3]  Hubert Eichner,et al.  APPLIED FEDERATED LEARNING: IMPROVING GOOGLE KEYBOARD QUERY SUGGESTIONS , 2018, ArXiv.

[4]  Kim-Kwang Raymond Choo,et al.  Blockchain: A Panacea for Healthcare Cloud-Based Data Security and Privacy? , 2018, IEEE Cloud Computing.

[5]  Xingqin Lin,et al.  A Primer on 3GPP Narrowband Internet of Things , 2016, IEEE Communications Magazine.

[6]  Jiannong Cao,et al.  Edge Mesh: A New Paradigm to Enable Distributed Intelligence in Internet of Things , 2017, IEEE Access.

[7]  Israel Leyva Mayorga,et al.  Trusted Wireless Monitoring Based on Distributed Ledgers over NB-IoT Connectivity , 2020, IEEE Communications Magazine.

[8]  Daniel Davis Wood,et al.  ETHEREUM: A SECURE DECENTRALISED GENERALISED TRANSACTION LEDGER , 2014 .

[9]  Joseph Sarkis,et al.  Blockchain technology and its relationships to sustainable supply chain management , 2018, Int. J. Prod. Res..

[10]  Sergio Barbarossa,et al.  Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing , 2014, IEEE Transactions on Signal and Information Processing over Networks.

[11]  Michael Devetsikiotis,et al.  Blockchains and Smart Contracts for the Internet of Things , 2016, IEEE Access.

[12]  Petar Popovski,et al.  Modeling and Analysis of Data Trading on Blockchain-Based Market in IoT Networks , 2021, IEEE Internet of Things Journal.

[13]  Mehdi Bennis,et al.  BayGo: Joint Bayesian Learning and Information-Aware Graph Optimization , 2020, ArXiv.

[14]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[15]  Ray-Guang Cheng,et al.  Modeling and Analysis of Random Access Channels With Bursty Arrivals in OFDMA Wireless Networks , 2015, IEEE Transactions on Wireless Communications.

[16]  Masahiro Morikura,et al.  Differentially Private AirComp Federated Learning with Power Adaptation Harnessing Receiver Noise , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[17]  Xinyu Yang,et al.  A Survey on the Edge Computing for the Internet of Things , 2018, IEEE Access.

[18]  Tiago M. Fernández-Caramés,et al.  A Review on the Use of Blockchain for the Internet of Things , 2018, IEEE Access.

[19]  Yulin Hu,et al.  Delay-Constrained Communication in Edge Computing Networks , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[20]  Anit Kumar Sahu,et al.  MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling , 2019, 2019 Sixth Indian Control Conference (ICC).

[21]  Xianfu Chen,et al.  Wireless Edge Computing With Latency and Reliability Guarantees , 2019, Proceedings of the IEEE.

[22]  Tianqing Zhu,et al.  Local Differential Privacy and Its Applications: A Comprehensive Survey , 2020, ArXiv.

[23]  Mehdi Bennis,et al.  Federated Learning under Channel Uncertainty: Joint Client Scheduling and Resource Allocation , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[24]  Kaibin Huang,et al.  Broadband Analog Aggregation for Low-Latency Federated Edge Learning , 2018, IEEE Transactions on Wireless Communications.

[25]  Han Yu,et al.  Threats to Federated Learning: A Survey , 2020, ArXiv.

[26]  Konstantinos Vandikas,et al.  Computations on the Edge in the Internet of Things , 2015, ANT/SEIT.

[27]  Deniz Gündüz,et al.  Over-the-Air Machine Learning at the Wireless Edge , 2019, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[28]  Filip Idzikowski,et al.  Power consumption of WLAN network elements , 2011 .

[29]  Mehdi Bennis,et al.  GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning , 2019, J. Mach. Learn. Res..

[30]  Kobi Cohen,et al.  On Analog Gradient Descent Learning Over Multiple Access Fading Channels , 2019, IEEE Transactions on Signal Processing.

[31]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[32]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[33]  Ameet Talwalkar,et al.  Federated Multi-Task Learning , 2017, NIPS.

[34]  Vincenzo Grassi,et al.  Optimal operator placement for distributed stream processing applications , 2016, DEBS.

[35]  Petar Popovski,et al.  Communication Aspects of the Integration of Wireless IoT Devices with Distributed Ledger Technology , 2019, IEEE Network.

[36]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[37]  Walid Saad,et al.  Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications , 2018, IEEE Transactions on Communications.

[38]  Hubert Eichner,et al.  Towards Federated Learning at Scale: System Design , 2019, SysML.

[39]  Matti Latva-aho,et al.  Proactive edge computing in fog networks with latency and reliability guarantees , 2018, EURASIP J. Wirel. Commun. Netw..

[40]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[41]  Petar Popovski,et al.  On the Latency-Energy Performance of NB-IoT Systems in Providing Wide-Area IoT Connectivity , 2020, IEEE Transactions on Green Communications and Networking.

[42]  Fei Tao,et al.  Blockchain-Based Trust Mechanism for IoT-Based Smart Manufacturing System , 2019, IEEE Transactions on Computational Social Systems.

[43]  Victor C. M. Leung,et al.  Blockchain-Based Decentralized Trust Management in Vehicular Networks , 2019, IEEE Internet of Things Journal.

[44]  Jun Zhao,et al.  Local Differential Privacy-Based Federated Learning for Internet of Things , 2020, IEEE Internet of Things Journal.

[45]  Vincent Savaux,et al.  A Tutorial on NB-IoT Physical Layer Design , 2020, IEEE Communications Surveys & Tutorials.

[46]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[47]  Klaus-Robert Müller,et al.  Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Ejaz Ahmed,et al.  The Role of Edge Computing in Internet of Things , 2018, IEEE Communications Magazine.

[49]  Nitinder Mohan,et al.  Edge-Fog cloud: A distributed cloud for Internet of Things computations , 2016, 2016 Cloudification of the Internet of Things (CIoT).

[50]  Richard Nock,et al.  Advances and Open Problems in Federated Learning , 2021, Found. Trends Mach. Learn..

[51]  M. Shamim Hossain,et al.  Internet of Things Cloud: Architecture and Implementation , 2016, IEEE Communications Standards.

[52]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[53]  David Bol,et al.  Can we connect trillions of IoT sensors in a sustainable way? A technology/circuit perspective (Invited) , 2015, 2015 IEEE SOI-3D-Subthreshold Microelectronics Technology Unified Conference (S3S).

[54]  H. Vincent Poor,et al.  Scheduling Policies for Federated Learning in Wireless Networks , 2019, IEEE Transactions on Communications.

[55]  Albert Y. Zomaya,et al.  Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence , 2019, IEEE Internet of Things Journal.

[56]  S. Nakamoto,et al.  Bitcoin: A Peer-to-Peer Electronic Cash System , 2008 .

[57]  Haruo Akimaru,et al.  Teletraffic: Theory and Applications , 1993 .

[58]  Georgios B. Giannakis,et al.  LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning , 2018, NeurIPS.

[59]  Mehdi Bennis,et al.  Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning , 2020, IEEE Transactions on Communications.

[60]  Deniz Gündüz,et al.  Computation Scheduling for Distributed Machine Learning with Straggling Workers , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[61]  Xiaofei Wang,et al.  Convergence of Edge Computing and Deep Learning: A Comprehensive Survey , 2019, IEEE Communications Surveys & Tutorials.

[62]  Jörg Henkel,et al.  Computation offloading and resource allocation for low-power IoT edge devices , 2016, 2016 IEEE 3rd World Forum on Internet of Things (WF-IoT).

[63]  Thaier Hayajneh,et al.  Healthcare Blockchain System Using Smart Contracts for Secure Automated Remote Patient Monitoring , 2018, Journal of Medical Systems.

[64]  Alagan Anpalagan,et al.  Emerging Edge Computing Technologies for Distributed IoT Systems , 2018, IEEE Network.

[65]  Tara Javidi,et al.  Peer-to-peer Federated Learning on Graphs , 2019, ArXiv.

[66]  Ke Zhang,et al.  Machine Learning at the Edge: A Data-Driven Architecture With Applications to 5G Cellular Networks , 2018, IEEE Transactions on Mobile Computing.

[67]  Ying Li,et al.  Placement Strategies for Internet-Scale Data Stream Systems , 2008, IEEE Internet Computing.

[68]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[69]  Mehdi Bennis,et al.  Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning , 2019, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[70]  Mehdi Bennis,et al.  Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM , 2020, ArXiv.

[71]  Arne Bröring,et al.  Optimally Self-Healing IoT Choreographies , 2020, ACM Trans. Internet Techn..