An Aggregative High-Order Singular Value Decomposition Method in Edge Computing

In edge computing, for dimensionality reduction and core data extraction, both edge computing node (ECN) and cloud server may implement a high-order singular value decomposition (HOSVD) algorithm before data are passed to local computing models. However, at present, many edge computing systems regard the two HOSVD procedures as two independent parts, which leads to repeated calculations in the cloud. In this paper, we propose an aggregative HOSVD method by reusing intermediate results of subtensor HOSVD in ECNs to reduce the HOSVD computing cost of the merged tensor in the cloud server. First, two equivalence lemmas of singular value decomposition (SVD) are proven. Second, the SVD left mergence algorithm (SVDLM), hierarchical-SVDLM (H-SVDLM) algorithm and aggregative HOSVD (AHOSVD) algorithm are proposed to obtain the HOSVD result of the merged tensor by efficiently merging the unfolded matrix SVD results of the subtensors. Finally, the efficiency and accuracy between the HOSVD and the AHOSVD are compared, and the experimental results validate that the proposed AHOSVD algorithm improves efficiency compared with the HOSVD algorithm in circumstances with comparable accuracy results with the HOSVD algorithm.

[1]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[2]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[3]  Laurence T. Yang,et al.  ADTT: A Highly Efficient Distributed Tensor-Train Decomposition Method for IIoT Big Data , 2021, IEEE Transactions on Industrial Informatics.

[4]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part II: Definitions and Uniqueness , 2008, SIAM J. Matrix Anal. Appl..

[5]  T. Kolda Multilinear operators for higher-order decompositions , 2006 .

[6]  Laurence T. Yang,et al.  A Distributed HOSVD Method With Its Incremental Computation for Big Data in Cyber-Physical-Social Systems , 2018, IEEE Transactions on Computational Social Systems.

[7]  Thar Baker,et al.  An Edge Computing Based Smart Healthcare Framework for Resource Management , 2018, Sensors.

[8]  Giancarlo Fortino,et al.  An Edge-Based Architecture to Support Efficient Applications for Healthcare Industry 4.0 , 2019, IEEE Transactions on Industrial Informatics.

[9]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[10]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part III: Alternating Least Squares Algorithms , 2008, SIAM J. Matrix Anal. Appl..

[11]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[12]  Erik G. Larsson,et al.  The Higher-Order Singular Value Decomposition: Theory and an Application [Lecture Notes] , 2010, IEEE Signal Processing Magazine.

[13]  Laurence T. Yang,et al.  A Cloud-Edge Computing Framework for Cyber-Physical-Social Services , 2017, IEEE Communications Magazine.

[14]  Laurence T. Yang,et al.  A Tensor-Based Approach for Big Data Representation and Dimensionality Reduction , 2014, IEEE Transactions on Emerging Topics in Computing.

[15]  Matthew Brand,et al.  Incremental Singular Value Decomposition of Uncertain Data with Missing Values , 2002, ECCV.

[16]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[17]  Laurence T. Yang,et al.  Tensor-Based Multiple Clustering Approaches for Cyber-Physical-Social Applications , 2020, IEEE Transactions on Emerging Topics in Computing.

[18]  Nikos D. Sidiropoulos,et al.  Tensors for Data Mining and Data Fusion , 2016, ACM Trans. Intell. Syst. Technol..

[19]  Mahadev Satyanarayanan,et al.  Edge Computing , 2017, Computer.

[20]  Xinyu Yang,et al.  A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications , 2017, IEEE Internet of Things Journal.

[21]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[22]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part I: Lemmas for Partitioned Matrices , 2008, SIAM J. Matrix Anal. Appl..

[23]  Nikos D. Sidiropoulos,et al.  Tensor Decomposition for Signal Processing and Machine Learning , 2016, IEEE Transactions on Signal Processing.

[24]  Laurence T. Yang,et al.  A Tensor Computation and Optimization Model for Cyber-Physical-Social Big Data , 2019, IEEE Transactions on Sustainable Computing.

[25]  Paul Van Dooren,et al.  Low-rank incremental methods for computing dominant singular subspaces☆ , 2012 .

[26]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[27]  Laurence T. Yang,et al.  A Multi-Order Distributed HOSVD with Its Incremental Computing for Big Services in Cyber-Physical-Social Systems , 2020, IEEE Transactions on Big Data.

[28]  Tarik Taleb,et al.  Edge Computing for the Internet of Things: A Case Study , 2018, IEEE Internet of Things Journal.

[29]  Pierre Comon,et al.  General tensor decomposition, moment matrices and applications , 2013, J. Symb. Comput..