Achieving Democracy in Edge Intelligence: A Fog-Based Collaborative Learning Scheme

The emergence of fog computing has brought unprecedented opportunities to the Internet of Things (IoT) field, and it is now feasible to incorporate deep learning at the edge of the IoT network to provide a wide range of highly tailored services. In this paper, we present a fog-based democratically collaborative learning scheme in which fog nodes collaborate on the model training process even without the support of the cloud, contributing to the advances of IoT in terms of realizing a more intelligent edge. To achieve that, we design a voting strategy so that a fog node could be elected as the coordinator node based on both distance and computational power metrics to coordinate the training process. Also, a collaborative learning algorithm is proposed to generalize the training of different deep learning models in the fog-enabled IoT environment. We then implement two popular use cases, including a user trajectory prediction and a distributed image recognition, to demonstrate the feasibility, practicality and effectiveness of the scheme. More importantly, the experiments on both use cases are conducted through a realworld, in-door fog deployment. The result shows that the scheme can utilize fog to obtain a well-performing deep learning model in the cloudless IoT environment while mitigating the data locality issue for each fog node.

[1]  Katherine Guo,et al.  Precog: prefetching for image recognition applications at the edge , 2017, SEC.

[2]  Bin Yang,et al.  Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Xu Chen,et al.  Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing , 2019, Proceedings of the IEEE.

[5]  Igor Bisio,et al.  Smart Probabilistic Fingerprinting for Indoor Localization over Fog Computing Platforms , 2016, 2016 5th IEEE International Conference on Cloud Networking (Cloudnet).

[6]  Prasad Calyam,et al.  Predictive analytics for fog computing using machine learning and GENI , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[7]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Thar Baker,et al.  Improving fog computing performance via Fog-2-Fog collaboration , 2019, Future Gener. Comput. Syst..

[9]  Igor Bisio,et al.  An AP-Centred Smart Probabilistic Fingerprint System for Indoor Positioning , 2018, 2018 IEEE International Conference on Communications (ICC).

[10]  Shaohan Hu,et al.  Deep Learning for the Internet of Things , 2018, Computer.

[11]  Albert Y. Zomaya,et al.  Performance and Energy Efficiency Metrics for Communication Systems of Cloud Computing Data Centers , 2017, IEEE Transactions on Cloud Computing.

[12]  Sherali Zeadally,et al.  Deploying Fog Computing in Industrial Internet of Things and Industry 4.0 , 2018, IEEE Transactions on Industrial Informatics.

[13]  Tie Qiu,et al.  Fog Computing Based Face Identification and Resolution Scheme in Internet of Things , 2017, IEEE Transactions on Industrial Informatics.

[14]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[15]  Philip H. S. Torr,et al.  DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Xukan Ran,et al.  Deep Learning With Edge Computing: A Review , 2019, Proceedings of the IEEE.

[17]  Muthucumaru Maheswaran,et al.  Using machine learning for handover optimization in vehicular fog computing , 2018, SAC.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Xin Yang,et al.  Learning the Conformal Transformation Kernel for Image Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Robert Piché,et al.  A Survey of Selected Indoor Positioning Methods for Smartphones , 2017, IEEE Communications Surveys & Tutorials.

[21]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Thar Baker,et al.  A Profitable and Energy-Efficient Cooperative Fog Solution for IoT Services , 2020, IEEE Transactions on Industrial Informatics.

[24]  Riti Gour,et al.  On Reducing IoT Service Delay via Fog Offloading , 2018, IEEE Internet of Things Journal.

[25]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[26]  Teruo Higashino,et al.  ICCF: An Information-Centric Collaborative Fog Platform for Building Energy Management Systems , 2019, IEEE Access.

[27]  Nirwan Ansari,et al.  Hierarchical Capacity Provisioning for Fog Computing , 2018, IEEE/ACM Transactions on Networking.

[28]  Nirwan Ansari,et al.  Towards Workload Balancing in Fog Computing Empowered IoT , 2020, IEEE Transactions on Network Science and Engineering.

[29]  Liang Gao,et al.  Adaptive Fog Configuration for the Industrial Internet of Things , 2018, IEEE Transactions on Industrial Informatics.

[30]  Naveen K. Chilamkurti,et al.  Leveraging LSTM Networks for Attack Detection in Fog-to-Things Communications , 2018, IEEE Communications Magazine.

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  Jason P. Jue,et al.  All One Needs to Know about Fog Computing and Related Edge Computing Paradigms , 2019 .

[33]  Igor Bisio,et al.  Context-awareness over transient cloud in D2D networks: energy performance analysis and evaluation , 2017, Trans. Emerg. Telecommun. Technol..

[34]  Vijay K. Bhargava,et al.  A Market-Based Framework for Multi-Resource Allocation in Fog Computing , 2018, IEEE/ACM Transactions on Networking.

[35]  H. T. Mouftah,et al.  Empowering Reinforcement Learning on Big Sensed Data for Intrusion Detection , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[36]  Robert Harle,et al.  Location Fingerprinting With Bluetooth Low Energy Beacons , 2015, IEEE Journal on Selected Areas in Communications.