Proximal Symmetric Non-negative Latent Factor Analysis: A Novel Approach to Highly-Accurate Representation of Undirected Weighted Networks

An Undirected Weighted Network (UWN) is commonly found in big data-related applications. Note that such a network's information connected with its nodes, and edges can be expressed as a Symmetric, High-Dimensional and Incomplete (SHDI) matrix. However, existing models fail in either modeling its intrinsic symmetry or low-data density, resulting in low model scalability or representation learning ability. For addressing this issue, a Proximal Symmetric Nonnegative Latent-factor-analysis (PSNL) model is proposed. It incorporates a proximal term into symmetry-aware and data density-oriented objective function for high representation accuracy. Then an adaptive Alternating Direction Method of Multipliers (ADMM)-based learning scheme is implemented through a Tree-structured of Parzen Estimators (TPE) method for high computational efficiency. Empirical studies on four UWNs demonstrate that PSNL achieves higher accuracy gain than state-of-the-art models, as well as highly competitive computational efficiency.

[1]  Zechao Li,et al.  Neulft: A Novel Approach to Nonlinear Canonical Polyadic Decomposition on High-Dimensional Incomplete Tensors , 2023, IEEE Transactions on Knowledge and Data Engineering.

[2]  Bo Shen,et al.  Proximal Alternating-Direction-Method-of-Multipliers-Incorporated Nonnegative Latent Factor Analysis , 2023, IEEE/CAA Journal of Automatica Sinica.

[3]  Yuchen Liu,et al.  Extracting and Composing Robust Features With Broad Learning System , 2023, IEEE Transactions on Knowledge and Data Engineering.

[4]  Mengchu Zhou,et al.  Fast and Accurate Non-Negative Latent Factor Analysis of High-Dimensional and Sparse Matrices in Recommender Systems , 2023, IEEE Transactions on Knowledge and Data Engineering.

[5]  Mengchu Zhou,et al.  A Momentum-Accelerated Hessian-Vector-Based Latent Factor Analysis Model , 2023, IEEE Transactions on Services Computing.

[6]  Yi He,et al.  A Double-Space and Double-Norm Ensembled Latent Factor Model for Highly Accurate Web Service QoS Prediction , 2023, IEEE Transactions on Services Computing.

[7]  Zhihui Zhu,et al.  A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization , 2023, IEEE Transactions on Knowledge and Data Engineering.

[8]  Long Jin,et al.  Gradient-Based Differential Neural-Solution to Time-Dependent Nonlinear Optimization , 2023, IEEE Transactions on Automatic Control.

[9]  Liangming Chen,et al.  Activated Gradients for Deep Neural Networks , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Xin Luo,et al.  Symmetry and Graph Bi-Regularized Non-Negative Matrix Factorization for Precise Community Detection , 2024, IEEE Transactions on Automation Science and Engineering.

[11]  Tiantian He,et al.  Two-Stream Graph Convolutional Network-Incorporated Latent Feature Analysis , 2023, IEEE Transactions on Services Computing.

[12]  Xin Luo,et al.  Nonnegative Latent Factor Analysis-Incorporated and Feature-Weighted Fuzzy Double $c$-Means Clustering for Incomplete Data , 2022, IEEE Transactions on Fuzzy Systems.

[13]  Xin Luo,et al.  Generalized Nesterov's Acceleration-Incorporated, Non-Negative and Adaptive Latent Factor Analysis , 2022, IEEE Transactions on Services Computing.

[14]  Zhigang Liu,et al.  Symmetry and Nonnegativity-Constrained Matrix Factorization for Community Detection , 2022, IEEE CAA J. Autom. Sinica.

[15]  Zidong Wang,et al.  Position-Transitional Particle Swarm Optimization-Incorporated Latent Factor Analysis , 2022, IEEE Transactions on Knowledge and Data Engineering.

[16]  Mingsheng Shang,et al.  A Kalman-Filter-Incorporated Latent Factor Analysis Model for Temporally Dynamic Sparse Data , 2022, IEEE Transactions on Cybernetics.

[17]  Yi He,et al.  A Data-Characteristic-Aware Latent Factor Model for Web Services QoS Prediction , 2022, IEEE Transactions on Knowledge and Data Engineering.

[18]  MengChu Zhou,et al.  Advancing Non-Negative Latent Factorization of Tensors With Diversified Regularization Schemes , 2022, IEEE Transactions on Services Computing.

[19]  Xiaoyu Shi,et al.  Large-Scale and Scalable Latent Factor Analysis via Distributed Alternative Stochastic Gradient Descent for Recommender Systems , 2022, IEEE Transactions on Big Data.

[20]  Xin Luo,et al.  Diversified Regularization Enhanced Training for Effective Manipulator Calibration , 2022, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Guoyin Wang,et al.  A Posterior-Neighborhood-Regularized Latent Factor Model for Highly Accurate Web Service QoS Prediction , 2022, IEEE Transactions on Services Computing.

[22]  Zidong Wang,et al.  Assimilating Second-Order Information for Building Non-Negative Latent Factor Analysis-Based Recommenders , 2022, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Deyu Meng,et al.  A Novel Approach to Large-Scale Dynamically Weighted Directed Network Representation , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Xin Luo,et al.  A Latent Factor Analysis-Based Approach to Online Sparse Streaming Feature Selection , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Xin Luo,et al.  Hierarchical Particle Swarm Optimization-incorporated Latent Factor Analysis for Large-Scale Incomplete Matrices , 2021, IEEE Transactions on Big Data.

[26]  Mingsheng Shang,et al.  An L1-and-L2-Norm-Oriented Latent Factor Model for Recommender Systems , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Mengchu Zhou,et al.  An α–β-Divergence-Generalized Recommender for Highly Accurate Predictions of Missing User Preferences , 2021, IEEE Transactions on Cybernetics.

[28]  Mengchu Zhou,et al.  Symmetric Nonnegative Matrix Factorization-Based Community Detection Models and Their Convergence Analysis , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[29]  S. Lauria,et al.  A New Particle Swarm Optimization Algorithm for Outlier Detection: Industrial Data Clustering in Wire Arc Additive Manufacturing , 2022, IEEE Transactions on Automation Science and Engineering.

[30]  Maozhen Li,et al.  An Alternating-Direction-Method of Multipliers-Incorporated Approach to Symmetric Non-Negative Latent Factor Analysis , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Mingsheng Shang,et al.  An Instance-Frequency-Weighted Regularization Scheme for Non-Negative Latent Factor Analysis on High-Dimensional and Sparse Data , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Xin Luo,et al.  Robust Latent Factor Analysis for Precise Representation of High-Dimensional and Sparse Data , 2021, IEEE/CAA Journal of Automatica Sinica.

[33]  MengChu Zhou,et al.  Efficient and High-quality Recommendations via Momentum-incorporated Parallel Stochastic Gradient Descent-Based Learning , 2021, IEEE/CAA Journal of Automatica Sinica.

[34]  MengChu Zhou,et al.  A Deep Latent Factor Model for High-Dimensional and Sparse Matrices in Recommender Systems , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Xiangnan He,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[36]  MengChu Zhou,et al.  An Effective Scheme for QoS Estimation via Alternating Direction Method-Based Matrix Factorization , 2019, IEEE Transactions on Services Computing.

[37]  Damian Szklarczyk,et al.  STRING v11: protein–protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets , 2018, Nucleic Acids Res..

[38]  MengChu Zhou,et al.  Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Shuai Li,et al.  Kinematic Control of Redundant Manipulators Using Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Shuai Li,et al.  Symmetric and Nonnegative Latent Factor Models for Undirected, High-Dimensional, and Sparse Networks in Industrial Applications , 2017, IEEE Transactions on Industrial Informatics.

[41]  Shuai Li,et al.  Distributed Recurrent Neural Networks for Cooperative Control of Manipulators: A Game-Theoretic Perspective , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[42]  MengChu Zhou,et al.  Distributed Winner-Take-All in Dynamic Networks , 2017, IEEE Transactions on Automatic Control.

[43]  Keith C. C. Chan,et al.  Large-scale prediction of drug-target interactions from deep representations , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[44]  Shuai Li,et al.  Inverse-Free Extreme Learning Machine With Optimal Information Updating , 2016, IEEE Transactions on Cybernetics.

[45]  Xiaochun Cao,et al.  A Unified Semi-Supervised Community Detection Framework Using Latent Space Graph Regularization , 2015, IEEE Transactions on Cybernetics.

[46]  Jianli Chen,et al.  A proximal alternating direction method of multipliers for a minimization problem with nonconvex constraints , 2015, J. Glob. Optim..

[47]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[48]  MengChu Zhou,et al.  An Efficient Non-Negative Matrix-Factorization-Based Approach to Collaborative Filtering for Recommender Systems , 2014, IEEE Transactions on Industrial Informatics.

[49]  Yin Zhang,et al.  An alternating direction algorithm for matrix completion with nonnegative factors , 2012, Frontiers of Mathematics in China.

[50]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[51]  Zhaoshui He,et al.  Symmetric Nonnegative Matrix Factorization: Algorithms and Applications to Probabilistic Clustering , 2011, IEEE Transactions on Neural Networks.

[52]  Timothy A. Davis,et al.  The university of Florida sparse matrix collection , 2011, TOMS.