Multipath TCP Meets Transfer Learning: A Novel Edge-Based Learning for Industrial IoT

We consider a fifth-generation (5G)-empowered future Industrial IoT (IIoT) networking problem where IIoT machines are capable of communicating and sharing their data networking knowledge gained (and experiences) with other neighboring devices/tools. For such an IIoT setting, deep-learning (DL)-based communication protocols are known to be highly efficient but having a computationally complex training procedure in terms of both time/space and volume of data sets. One solution for such training is to be completed offline for each equipment and machines of IIoT before deployment. A better approach would be to replicate the model from the expert existing machine and implant it into new machines. Such training for the transfer of knowledge can be done by manufacturers using high computational power, even for large-scale DL models. After sufficient training and the desired level of accuracy, the trained machines can be deployed in the smart factory equipment to perform life-long collaborative learning. We design a novel distributed transfer learning (TL) framework to maximize multipath communication networking performance for Industry 4.0 environment. To conduct seamless sharing of knowledge gain by the multipath TCP (MPTCP) agents and tackle retraining issues of DL-based approaches, we investigate TL for MPTCP from the IIoT networking perspective. With relevant insights from transfer and collaborative learning, we develop a distributed TL-MPTCP framework to accelerate the learning efficiency and enhance the performance of newly deployed machines. Our approach is validated with numerical and emulated NS-3 experiments in comparison with the state-of-the-art schemes.

[1]  Zhiyuan Xu,et al.  Experience-Driven Congestion Control: When Multi-Path TCP Meets Deep Reinforcement Learning , 2019, IEEE Journal on Selected Areas in Communications.

[2]  Brighten Godfrey,et al.  A Deep Reinforcement Learning Perspective on Internet Congestion Control , 2019, ICML.

[3]  Hai Le Vu,et al.  TCP Performance over Wi-Fi: Joint Impact of Buffer and Channel Losses , 2016, IEEE Transactions on Mobile Computing.

[4]  Tommaso Melodia,et al.  DeepWiERL: Bringing Deep Reinforcement Learning to the Internet of Self-Adaptive Things , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[5]  Kim-Kwang Raymond Choo,et al.  Smart Collaborative Automation for Receive Buffer Control in Multipath Industrial Networks , 2020, IEEE Transactions on Industrial Informatics.

[6]  Philip Levis,et al.  Pantheon: the training ground for Internet congestion-control research , 2018, USENIX Annual Technical Conference.

[7]  Chaojing Xue,et al.  SmartCC: A Reinforcement Learning Approach for Multipath TCP Congestion Control in Heterogeneous Networks , 2019, IEEE Journal on Selected Areas in Communications.

[8]  Weiming Shen,et al.  Agent-Oriented Cooperative Smart Objects: From IoT System Design to Implementation , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Tie-Yan Liu,et al.  Target Transfer Q-Learning and Its Convergence Analysis , 2018, Neurocomputing.

[10]  Jun Zhao,et al.  Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications , 2020 .

[11]  Kaishun Wu,et al.  Adaptive Online Decision Method for Initial Congestion Window in 5G Mobile Edge Computing Using Deep Reinforcement Learning , 2020, IEEE Journal on Selected Areas in Communications.

[12]  Lakshminarayanan Subramanian,et al.  Adaptive Congestion Control for Unpredictable Cellular Networks , 2015, Comput. Commun. Rev..

[13]  Mark Handley,et al.  Coupled Congestion Control for Multipath Transport Protocols , 2011, RFC.

[14]  Steven H. Low,et al.  Multipath TCP: Analysis, Design, and Implementation , 2013, IEEE/ACM Transactions on Networking.

[15]  Michel Mandjes,et al.  Improving Multipath TCP Performance over WiFi and Cellular Networks: An Analytical Approach , 2019, IEEE Transactions on Mobile Computing.

[16]  Jinho Choi,et al.  Improving TCP Performance Over WiFi for Internet of Vehicles: A Federated Learning Approach , 2020, IEEE Transactions on Vehicular Technology.

[17]  Shiva Raj Pokhrel,et al.  QoS-Aware Personalized Privacy With Multipath TCP for Industrial IoT: Analysis and Design , 2020, IEEE Internet of Things Journal.

[18]  Jinho Choi,et al.  Federated Learning With Blockchain for Autonomous Vehicles: Analysis and Design Challenges , 2020, IEEE Transactions on Communications.

[19]  Hari Balakrishnan,et al.  TCP ex machina: computer-generated congestion control , 2013, SIGCOMM.

[20]  Giancarlo Fortino,et al.  Simulation-Driven Platform for Edge-Based AAL Systems , 2021, IEEE Journal on Selected Areas in Communications.

[21]  Kehe Zhu,et al.  THEORY OF BERGMAN SPACES IN THE UNIT BALL OF C n , 2006, math/0611093.

[22]  Juergen Jasperneite,et al.  The Future of Industrial Communication: Automation Networks in the Era of the Internet of Things and Industry 4.0 , 2017, IEEE Industrial Electronics Magazine.

[23]  Mo Dong,et al.  PCC: Re-architecting Congestion Control for Consistent High Performance , 2014, NSDI.

[24]  Giancarlo Fortino,et al.  Data Mining at the IoT Edge , 2019, 2019 28th International Conference on Computer Communication and Networks (ICCCN).

[25]  Shiva Raj Pokhrel,et al.  Fair Coexistence of Regular and Multipath TCP over Wireless Last-Miles , 2019, IEEE Transactions on Mobile Computing.

[26]  László Monostori,et al.  Value Function Based Reinforcement Learning in Changing Markovian Environments , 2008, J. Mach. Learn. Res..

[27]  Carey Williamson,et al.  Modeling Compound TCP Over WiFi for IoT , 2018, IEEE/ACM Transactions on Networking.

[28]  Shiva Raj Pokhrel,et al.  Multipath Communication With Deep Q-Network for Industry 4.0 Automation and Orchestration , 2021, IEEE Transactions on Industrial Informatics.

[29]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[30]  Shiva Raj Pokhrel Federated learning meets blockchain at 6G edge: a drone-assisted networking for disaster response , 2020, DroneCom@MOBICOM.

[31]  Yanjiao Chen,et al.  Eagle: Refining Congestion Control by Learning from the Experts , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[32]  Giuseppe Caso,et al.  Peekaboo: Learning-Based Multipath Scheduling for Dynamic Heterogeneous Environments , 2020, IEEE Journal on Selected Areas in Communications.

[33]  Miroslav Popovic,et al.  MPTCP Is Not Pareto-Optimal: Performance Issues and a Possible Solution , 2013, IEEE/ACM Transactions on Networking.

[34]  Fei Hu Cyber-Physical Systems: Integrated Computing and Engineering Design , 2013 .

[35]  Shiva Raj Pokhrel,et al.  Compound TCP Performance for Industry 4.0 WiFi: A Cognitive Federated Learning Approach , 2021, IEEE Transactions on Industrial Informatics.