Random-Mode Frank-Wolfe Algorithm for Tensor Completion in Wireless Edge Caching

Wireless edge caching is a popular strategy to avoid backhaul congestion in the next generation networks, where the content is cached in advance at the base stations to fulfil the redundant requests during peak periods. In the edge caching data, the missing observations are inevitable due to dynamic selective popularity. Among the completion methods, the tensorbased models have been shown to be the most advantageous for missing data imputation. Also, since the observations are correlated across time, files, and base stations, in this paper, we formulate the caching, prediction and recommendation problem as a fourth-order tensor completion problem. Since the content library can be large leading to a large dimension tensor, we modify the latent norm-based Frank-Wolfe (FW) algorithm with tensor-ring decomposition towards a lower time complexity using random mode selection. Analyzing the time and space complexity of the algorithm shows N -times reduction in computational time where N is the order of tensor. Simulations with MovieLens dataset shows the approximately similar reconstruction errors for the presented FW algorithm as compared to that of the recent FW algorithm, albeit with lower computation overhead. It is also demonstrated that the completed tensor improves normalized cache hit rates for linear prediction schemes.

[1]  Chao Li,et al.  Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion , 2018, AAAI.

[2]  Naoto Yokoya,et al.  Hyperspectral Image Compressive Sensing Reconstruction Using Subspace-Based Nonlocal Tensor Ring Decomposition , 2020, IEEE Transactions on Image Processing.

[3]  V. Aggarwal,et al.  Efficient Low Rank Tensor Ring Completion , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Minh N. Do,et al.  Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train , 2016, IEEE Transactions on Image Processing.

[5]  Bartlomiej Blaszczyszyn,et al.  Optimal geographic caching in cellular networks , 2014, 2015 IEEE International Conference on Communications (ICC).

[6]  Massimiliano Pontil,et al.  A New Convex Relaxation for Tensor Completion , 2013, NIPS.

[7]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[8]  Ling Luo,et al.  Caching Placement with Recommendation Systems for Cache-Enabled Mobile Social Networks , 2017, IEEE Communications Letters.

[9]  Tharmalingam Ratnarajah,et al.  Modeling and Performance of Uplink Cache-Enabled Massive MIMO Heterogeneous Networks , 2018, IEEE Transactions on Wireless Communications.

[10]  Tharmalingam Ratnarajah,et al.  Content Placement Learning for Success Probability Maximization in Wireless Edge Caching Networks , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Qibin Zhao,et al.  Tensor-ring Nuclear Norm Minimization and Application for Visual : Data Completion , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.

[13]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[15]  Omar Y. Al-Jarrah,et al.  Popularity-Based Video Caching Techniques for Cache-Enabled Networks: A Survey , 2019, IEEE Access.

[16]  Branka Vucetic,et al.  Localized Small Cell Caching: A Machine Learning Approach Based on Rating Data , 2019, IEEE Transactions on Communications.

[17]  Ivan V. Oseledets,et al.  Tensor methods and recommender systems , 2016, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[18]  Kim Batselier The trouble with tensor ring decompositions , 2018, ArXiv.

[19]  Iordanis Koutsopoulos,et al.  Jointly Optimizing Content Caching and Recommendations in Small Cell Networks , 2019, IEEE Transactions on Mobile Computing.

[20]  Nikos D. Sidiropoulos,et al.  Coupled Graphs and Tensor Factorization for Recommender Systems and Community Detection , 2018, IEEE Transactions on Knowledge and Data Engineering.

[21]  Hong-Yuan Mark Liao,et al.  Simultaneous Tensor Decomposition and Completion Using Factor Priors , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yipeng Liu,et al.  Low CP Rank and Tucker Rank Tensor Completion for Estimating Missing Components in Image Data , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Martin Jaggi,et al.  Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization , 2013, ICML.

[24]  Nicolas Le Roux,et al.  A latent factor model for highly multi-relational data , 2012, NIPS.

[25]  Tharmalingam Ratnarajah,et al.  In-Network Caching for Hybrid Satellite-Terrestrial Networks Using Deep Reinforcement Learning , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Choong Seon Hong,et al.  Cache Aware User Association for Wireless Heterogeneous Networks , 2019, IEEE Access.

[27]  Taiji Suzuki,et al.  Convex Tensor Decomposition via Structured Schatten Norm Regularization , 2013, NIPS.

[28]  Tharmalingam Ratnarajah,et al.  Online Content Popularity Prediction and Learning in Wireless Edge Caching , 2020, IEEE Transactions on Communications.

[29]  Xiaohu You,et al.  User Preference Learning-Based Edge Caching for Fog Radio Access Network , 2018, IEEE Transactions on Communications.

[30]  Wai-Xi Liu,et al.  Content Popularity Prediction and Caching for ICN: A Deep Learning Approach With SDN , 2018, IEEE Access.

[31]  Xiaobin Tan,et al.  Software-Defined Multimedia Streaming System Aided By Variable-Length Interval In-Network Caching , 2019, IEEE Transactions on Multimedia.

[32]  Xiaojiang Du,et al.  Cooperative Content Caching for Mobile Edge Computing With Network Coding , 2019, IEEE Access.

[33]  Andong Wang,et al.  Latent Schatten TT Norm for Tensor Completion , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Weiping Li,et al.  PPC: Popularity Prediction Caching in ICN , 2018, IEEE Communications Letters.

[35]  Jiqiang Wu,et al.  Modeling Dynamics of Online Video Popularity , 2016, IEEE Transactions on Multimedia.

[36]  Hong Cheng,et al.  Trace Norm Regularized CANDECOMP/PARAFAC Decomposition With Missing Data , 2015, IEEE Transactions on Cybernetics.

[37]  R. Bro PARAFAC. Tutorial and applications , 1997 .

[38]  Masashi Sugiyama,et al.  Learning Efficient Tensor Representations with Ring-structured Networks , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Naoto Yokoya,et al.  Nonlocal Tensor-Ring Decomposition for Hyperspectral Image Denoising , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Liqing Zhang,et al.  Tensor Ring Decomposition , 2016, ArXiv.

[41]  Rick S. Blum,et al.  A Survey of Caching Techniques in Cellular Networks: Research Issues and Challenges in Content Placement and Delivery Strategies , 2018, IEEE Communications Surveys & Tutorials.

[42]  Hiroki Nakayama,et al.  Caching algorithm for content-oriented networks using prediction of popularity of contents , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[43]  Jianting Cao,et al.  Higher-dimension Tensor Completion via Low-rank Tensor Ring Decomposition , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[44]  Chenyang Yang,et al.  Temporal-Spatial Recommendation for Caching at Base Stations via Deep Reinforcement Learning , 2019, IEEE Access.

[45]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless Content Delivery Through Distributed Caching Helpers , 2013, IEEE Transactions on Information Theory.

[46]  Konstantinos Poularakis,et al.  On the Complexity of Optimal Content Placement in Hierarchical Caching Networks , 2016, IEEE Transactions on Communications.

[47]  Yuning Qiu,et al.  An Efficient Tensor Completion Method Via New Latent Nuclear Norm , 2019, IEEE Access.

[48]  Jasper Goseling,et al.  Optimal Geographical Caching in Heterogeneous Cellular Networks with Nonhomogeneous Helpers , 2017, ArXiv.

[49]  Lifeng Wang,et al.  Performance Analysis and Optimization of Cache-Enabled Small Cell Networks , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[50]  Qibin Zhao,et al.  An Effective Tensor Completion Method Based on Multi-linear Tensor Ring Decomposition , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[51]  Hidekata Hontani,et al.  Simultaneous Tensor Completion and Denoising by Noise Inequality Constrained Convex Optimization , 2018, IEEE Access.

[52]  Zhu Han,et al.  A prediction-based coordination caching scheme for content centric networking , 2018, 2018 27th Wireless and Optical Communication Conference (WOCC).

[53]  Jinkuan Wang,et al.  Multidimensional data learning-based caching strategy in information-centric networks , 2017, 2017 IEEE International Conference on Communications (ICC).

[54]  Tharmalingam Ratnarajah,et al.  Function Approximation Based Reinforcement Learning for Edge Caching in Massive MIMO Networks , 2021, IEEE Transactions on Communications.

[55]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Thrasyvoulos Spyropoulos,et al.  Soft Cache Hits: Improving Performance Through Recommendation and Delivery of Related Content , 2018, IEEE Journal on Selected Areas in Communications.

[57]  Alireza Sadeghi,et al.  Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-Time Popularities , 2017, IEEE Journal of Selected Topics in Signal Processing.

[58]  James T. Kwok,et al.  Efficient Sparse Low-Rank Tensor Completion Using the Frank-Wolfe Algorithm , 2017, AAAI.