An Overview of Frank-Wolfe Optimization for Stochasticity Constrained Interpretable Matrix and Tensor Factorization

In this paper we give an overview about utilizing Frank Wolfe optimization to find interpretable constrained matrix and tensor factorizations. We will particularly concentrate on imposing stochasticity constraints and show how factors of Archetypal Analysis as well as Decomposition Into Directed Components can be found using Frank Wolfe optimization to respectively decompose bipartite matrices and asymmetric similarity tensors. We will show how the derived algorithms perform by presenting case studies from behavioral profiling in digital games.

[1]  Lars Kai Hansen,et al.  Archetypal analysis for machine learning , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[2]  Christian Bauckhage,et al.  Predicting Retention in Sandbox Games with Tensor Factorization-based Representation Learning , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[3]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[4]  Domonkos Tikk,et al.  Scalable Collaborative Filtering Approaches for Large Recommender Systems , 2009, J. Mach. Learn. Res..

[5]  Alla Rozovskaya,et al.  Using DEDICOM for Completely Unsupervised Part-of-Speech Tagging , 2009 .

[6]  Christian Bauckhage A Neural Network Implementation of Frank-Wolfe Optimization , 2017, ICANN.

[7]  Christian Bauckhage,et al.  Online k-Maxoids Clustering , 2017, 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[8]  Martin Jaggi,et al.  Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization , 2013, ICML.

[9]  Tamara G. Kolda,et al.  Temporal Analysis of Semantic Graphs Using ASALSAN , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[10]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[11]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[12]  Christian Bauckhage,et al.  Archetypal Game Recommender Systems , 2014, LWA.

[13]  Johanna Pirker,et al.  Integrating and Inspecting Combined Behavioral Profiling and Social Network Models in Destiny , 2016, ICEC.