Intelligence Graph

In fact, there exist three genres of intelligence architectures: logics (e.g. Random Forest, A∗ Searching), neurons (e.g. CNN, LSTM) and probabilities (e.g. Naive Bayes, HMM), all of which are incompatible to each other. However, to construct powerful intelligence systems with various methods, we propose the intelligence graph (short as iGraph), which is composed by both of neural and probabilistic graph, under the framework of forward-backward propagation. By the paradigm of iGraph, we design a recommendation model with semantic principle. First, the probabilistic distributions of categories are generated from the embedding representations of users/items, in the manner of neurons. Second, the probabilistic graph infers the distributions of features, in the manner of probabilities. Last, for the recommendation diversity, we perform an expectation computation then conduct a logic judgment, in the manner of logics. Experimentally, we beat the state-of-the-art baselines and verify our conclusions.

[1]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[2]  Han-Gyu Ko,et al.  Multi-Aspect Collaborative Filtering based on Linked Data for Personalized Recommendation , 2015, WWW.

[3]  Han Xiao,et al.  KSR: A Semantic Representation of Knowledge Graph within a Novel Unsupervised Paradigm , 2016, 1608.07685.

[4]  Inderjit S. Dhillon,et al.  Guaranteed Rank Minimization via Singular Value Projection , 2009, NIPS.

[5]  Heng Huang,et al.  Optimal Discrete Matrix Completion , 2016, AAAI.

[6]  Jing Liu,et al.  Personalized Geo-Specific Tag Recommendation for Photos on Social Websites , 2014, IEEE Transactions on Multimedia.

[7]  Guandong Xu,et al.  Social network-based service recommendation with trust enhancement , 2014, Expert Syst. Appl..

[8]  Yihua Li,et al.  Blind Regression: Nonparametric Regression for Latent Variable Models via Collaborative Filtering , 2016, NIPS.

[9]  Jieping Ye,et al.  Rank-One Matrix Pursuit for Matrix Completion , 2014, ICML.

[10]  Samy Bengio,et al.  LLORMA: Local Low-Rank Matrix Approximation , 2016, J. Mach. Learn. Res..

[11]  Ji Feng,et al.  Deep Forest: Towards An Alternative to Deep Neural Networks , 2017, IJCAI.

[12]  Bart Vandereycken,et al.  Low-Rank Matrix Completion by Riemannian Optimization , 2013, SIAM J. Optim..

[13]  Jin-guang Sun,et al.  A Neighborhood-based Matrix Factorization Technique for Recommendation , 2015 .

[14]  Han Xiao,et al.  NDT: Neual Decision Tree Towards Fully Functioned Neural Graph , 2017, Unmanned Syst..

[15]  Shi Feng,et al.  Localized matrix factorization for recommendation based on matrix block diagonal forms , 2013, WWW.

[16]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Franz J. Király,et al.  The algebraic combinatorial approach for low-rank matrix completion , 2012, J. Mach. Learn. Res..

[18]  Robert Tibshirani,et al.  Spectral Regularization Algorithms for Learning Large Incomplete Matrices , 2010, J. Mach. Learn. Res..

[19]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[20]  Rebecca Willett,et al.  Matrix Completion Under Monotonic Single Index Models , 2015, NIPS.

[21]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[22]  Hao Ma,et al.  An experimental study on implicit social recommendation , 2013, SIGIR.

[23]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[24]  Han Xiao Hungarian Layer: Logics Empowered Neural Architecture , 2017, ArXiv.

[25]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[26]  Xin Liu,et al.  Learning Optimal Social Dependency for Recommendation , 2016, ArXiv.

[27]  Nathan Srebro,et al.  Fast maximum margin matrix factorization for collaborative prediction , 2005, ICML.

[28]  Yu-Jin Zhang,et al.  Nonnegative Matrix Factorization: A Comprehensive Review , 2013, IEEE Transactions on Knowledge and Data Engineering.

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Han Xiao,et al.  SAR: Semantic Analysis for Recommendation , 2017 .