Improved Latent Factor Models for Undirected and Sparse Networks with Large Scales

Nonnegative latent factor (NLF) models are highly efficient in extracting useful information from undirected, high-dimension, nonnegative and sparse (SHiDS) networks, which are commonly encountered in various industrial applications. The conventional double factorization (DF)-based matrix factorization (MF) technique contributes to obtaining LFs from SHiDs networks, whereas might lead to a fairly low prediction accuracy due to the limitation of the number of variables in NLF matrix. In order to tackle this problem, a novel NLF model via the trip factorization (TF)-based matrix MF technique is proposed, which is definitely equipped with 1) fulfilling the constrains on the symmetry; 2) a higher prediction accuracy; and 3) the nonnegativity of the NLF matrix. Experimental results on two data sets from real industrial applications demonstrate that the proposed TF-based NLF model has a better capability of guaranteeing the desirable performance at a bit expense of computational efficiency.

[1]  Ruslan Salakhutdinov,et al.  Collaborative Filtering in a Non-Uniform World: Learning with the Weighted Trace Norm , 2010, NIPS.

[2]  Shuai Li,et al.  Symmetric and Nonnegative Latent Factor Models for Undirected, High-Dimensional, and Sparse Networks in Industrial Applications , 2017, IEEE Transactions on Industrial Informatics.

[3]  Yihong Gong,et al.  Fast nonparametric matrix factorization for large-scale collaborative filtering , 2009, SIGIR.

[4]  Ivor W. Tsang,et al.  A Unified Feature Selection Framework for Graph Embedding on High Dimensional Data , 2015, IEEE Transactions on Knowledge and Data Engineering.

[5]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[6]  Zidong Wang,et al.  Near-Optimal Resilient Control Strategy Design for State-Saturated Networked Systems Under Stochastic Communication Protocol , 2019, IEEE Transactions on Cybernetics.

[7]  S. De Vito,et al.  Semi-Supervised Learning Techniques in Artificial Olfaction: A Novel Approach to Classification Problems and Drift Counteraction , 2012, IEEE Sensors Journal.

[8]  Zhaohui Wu,et al.  An Efficient Recommendation Method for Improving Business Process Modeling , 2014, IEEE Transactions on Industrial Informatics.

[9]  Guisong Yang,et al.  Improved Symmetric and Nonnegative Matrix Factorization Models for Undirected, Sparse and Large-Scaled Networks: A Triple Factorization-Based Approach , 2020, IEEE Transactions on Industrial Informatics.

[10]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[11]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[12]  Junbin Gao,et al.  Correlated Spatio-Temporal Data Collection in Wireless Sensor Networks Based on Low Rank Matrix Approximation and Optimized Node Sampling , 2014, Sensors.

[13]  Yan Song,et al.  Robust model predictive control for polytopic uncertain systems with state saturation nonlinearities under Round‐Robin protocol , 2019, International Journal of Robust and Nonlinear Control.

[14]  Yan Song,et al.  Distributed output feedback MPC with randomly occurring actuator saturation and packet loss , 2016 .

[15]  Nikos D. Sidiropoulos,et al.  Non-Negative Matrix Factorization Revisited: Uniqueness and Algorithm for Symmetric Decomposition , 2014, IEEE Transactions on Signal Processing.

[16]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[17]  MengChu Zhou,et al.  Generating Highly Accurate Predictions for Missing QoS Data via Aggregating Nonnegative Latent Factor Models , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[19]  Min Wu,et al.  State Estimation for Discrete Time-Delayed Genetic Regulatory Networks With Stochastic Noises Under the Round-Robin Protocols , 2018, IEEE Transactions on NanoBioscience.

[20]  Qiang Yang,et al.  Tracking Mobile Users in Wireless Networks via Semi-Supervised Colocalization , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Zidong Wang,et al.  $H_{\infty}$ State Estimation for Discrete-Time Nonlinear Singularly Perturbed Complex Networks Under the Round-Robin Protocol , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Wei Chu,et al.  Probabilistic Models for Incomplete Multi-dimensional Arrays , 2009, AISTATS.

[23]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[25]  Yan Song,et al.  Robust $H_{2}/H_\infty$ Model Predictive Control for Linear Systems With Polytopic Uncertainties Under Weighted MEF-TOD Protocol , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  Weixiong Zhang,et al.  Identification of hybrid node and link communities in complex networks , 2013, Scientific Reports.

[27]  Christian S. Jensen,et al.  EcoMark: evaluating models of vehicular environmental impact , 2012, SIGSPATIAL/GIS.

[28]  MengChu Zhou,et al.  A Nonnegative Latent Factor Model for Large-Scale Sparse Matrices in Recommender Systems via Alternating Direction Method , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[29]  MengChu Zhou,et al.  An Efficient Non-Negative Matrix-Factorization-Based Approach to Collaborative Filtering for Recommender Systems , 2014, IEEE Transactions on Industrial Informatics.

[30]  Yan Song,et al.  Robust MPC under event-triggered mechanism and Round-Robin protocol: An average dwell-time approach , 2018, Inf. Sci..

[31]  Pierre Geurts,et al.  DMFSGD: A Decentralized Matrix Factorization Algorithm for Network Distance Prediction , 2012, IEEE/ACM Transactions on Networking.

[32]  Yang Xiang,et al.  A survey on security control and attack detection for industrial cyber-physical systems , 2018, Neurocomputing.

[33]  Zidong Wang,et al.  Nonfragile Near-Optimal Control of Stochastic Time-Varying Multiagent Systems With Control- and State-Dependent Noises , 2019, IEEE Transactions on Cybernetics.

[34]  Qing-Long Han,et al.  Finite-Time $H_{\infty}$ State Estimation for Discrete Time-Delayed Genetic Regulatory Networks Under Stochastic Communication Protocols , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[35]  Zoubin Ghahramani,et al.  Probabilistic machine learning and artificial intelligence , 2015, Nature.

[36]  Yan Song,et al.  Robust model predictive control under redundant channel transmission with applications in networked DC motor systems , 2016 .

[37]  Qing-Long Han,et al.  Security control for a class of discrete-time stochastic nonlinear systems subject to deception attacks , 2016 .

[38]  Sotirios Chatzis,et al.  Nonparametric bayesian multitask collaborative filtering , 2013, CIKM.

[39]  Seungjin Choi,et al.  Orthogonal nonnegative matrix tri-factorization for co-clustering: Multiplicative updates on Stiefel manifolds , 2010, Inf. Process. Manag..