JointRec: A Deep-Learning-Based Joint Cloud Video Recommendation Framework for Mobile IoT

In the era of Internet of Things (IoT), watching videos on mobile devices has been a popular application in our daily life. How to recommend videos to users is one of the most concerned problem for Internet video service providers (IVSPs). In order to provide better recommendation service to users, they deploy cloud servers in a geo-distributed manner. Each server is responsible for analyzing a local area of user data. Therefore, these cloud servers form information islands and the characteristics of data present nonindependent and identically distribution (non-i.i.d). In this scenario, it is difficult to provide accurate video recommendation service to the minority of users in each area. To tackle this issue, we propose JointRec, a deep learning-based joint cloud video recommendation framework. JointRec integrates the JointCloud architecture into mobile IoT and achieves federated training among distributed cloud servers. Specifically, we first design a dual-convolutional probabilistic matrix factorization (Dual-CPMF) model to conduct video recommendation. Based on this model, each cloud can recommend videos by exploiting the user’s profiles and description of videos that users rate, thereby providing more accurate video recommendation services. Then, we present a federated recommendation algorithm which enables each cloud to share their weights and train a model cooperatively. Furthermore, considering the heavy communication costs in the process of federated training, we combine low-rank matrix factorization and 8-bit quantization method to reduce uplink communication costs and network bandwidth. We validate the proposed approach on the real-world data set, and the experimental results indicate the effectiveness of our proposed approach.

[1]  P. Wan,et al.  Near-Optimal and Truthful Online Auction for Computation Offloading in Green Edge-Computing Systems , 2020, IEEE Transactions on Mobile Computing.

[2]  Ning Zhang,et al.  A Novel Charging Scheme for Electric Vehicles With Smart Communities in Vehicular Networks , 2019, IEEE Transactions on Vehicular Technology.

[3]  Hao Yin,et al.  Improving Cloud Gaming Experience through Mobile Edge Computing , 2019, IEEE Wireless Communications.

[4]  Zhigang Chen,et al.  Utility-Optimal Resource Management and Allocation Algorithm for Energy Harvesting Cognitive Radio Sensor Networks , 2016, IEEE Journal on Selected Areas in Communications.

[5]  Zhongming Zheng,et al.  Green Energy and Content-Aware Data Transmissions in Maritime Wireless Communication Networks , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Huaimin Wang,et al.  JointCloud: A Cross-Cloud Cooperation Architecture for Integrated Internet Service Customization , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[7]  Ming Yang,et al.  Compressing Deep Convolutional Networks using Vector Quantization , 2014, ArXiv.

[8]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[9]  Feng Li,et al.  Edge Provisioning with Flexible Server Placement , 2017, IEEE Transactions on Parallel and Distributed Systems.

[10]  Geyong Min,et al.  SSL: A Surrogate-Based Method for Large-Scale Statistical Latency Measurement , 2020, IEEE Transactions on Services Computing.

[11]  Alexander J. Smola,et al.  Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS) , 2014, KDD.

[12]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[13]  Zhou Su,et al.  BSIS: Blockchain-Based Secure Incentive Scheme for Energy Delivery in Vehicular Energy Network , 2019, IEEE Transactions on Industrial Informatics.

[14]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[15]  Zhou Su,et al.  Distributed Task Allocation to Enable Collaborative Autonomous Driving With Network Softwarization , 2018, IEEE Journal on Selected Areas in Communications.

[16]  Zibin Zheng,et al.  IoT Service Based on JointCloud Blockchain: The Case Study of Smart Traveling , 2018, 2018 IEEE Symposium on Service-Oriented System Engineering (SOSE).

[17]  Feng Xia,et al.  Deep User Modeling for Content-based Event Recommendation in Event-based Social Networks , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[18]  Wei Li,et al.  JCDTA: The Data Trading Archtecture Design in JointCloud Computing , 2018, 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS).

[19]  Kin K. Leung,et al.  When Edge Meets Learning: Adaptive Control for Resource-Constrained Distributed Machine Learning , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[20]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[21]  Ohad Shamir,et al.  Communication Complexity of Distributed Convex Learning and Optimization , 2015, NIPS.

[22]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[23]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[24]  Paolo Cremonesi,et al.  Exploring the Semantic Gap for Movie Recommendations , 2017, RecSys.

[25]  Yueting Zhuang,et al.  Social-Aware Movie Recommendation via Multimodal Network Learning , 2018, IEEE Transactions on Multimedia.

[26]  Wang Huaimin,et al.  JCLedger: A Blockchain Based Distributed Ledger for JointCloud Computing , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[27]  Ting Liu,et al.  User Modeling with Neural Network for Review Rating Prediction , 2015, IJCAI.

[28]  Xiaohui Zhang,et al.  Parallel training of Deep Neural Networks with Natural Gradient and Parameter Averaging , 2014, ICLR.

[29]  Geyong Min,et al.  Resource Provisioning in the Edge for IoT Applications With Multilevel Services , 2019, IEEE Internet of Things Journal.

[30]  Donghyun Kim,et al.  Convolutional Matrix Factorization for Document Context-Aware Recommendation , 2016, RecSys.

[31]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[32]  William J. Dally,et al.  Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training , 2017, ICLR.

[33]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[34]  Hao Liang,et al.  Efficient Scheduling for Video Transmissions in Maritime Wireless Communication Networks , 2015, IEEE Transactions on Vehicular Technology.