Design of Momentum Fractional Stochastic Gradient Descent for Recommender Systems

The demand for recommender systems in E-commerce industry has increased tremendously. Efficient recommender systems are being proposed by different E-business companies with the intention to give users accurate and most relevant recommendation of products from huge amount of information. To improve the performance of recommender systems, various stochastic variants of gradient descent based algorithms have been reported. The scalability requirement of recommender systems needs algorithms with fast convergence to generate recommendations of specific items. Using the concepts of fractional calculus, an efficient variant of the stochastic gradient descent (SGD) was developed for fast convergence. Such fractional SGD (F-SGD) is further accelerated by adding a momentum term, thus termed as momentum fractional stochastic gradient descent (mF-SGD). The proposed mF-SGD method is shown to offer improved estimation accuracy and convergence rate, as compared to F-SGD and standard momentum SGD for different proportions of previous gradients, fractional orders, learning rates and number of features.

[1]  Arun K. Pujari,et al.  Conformal matrix factorization based recommender system , 2018, Inf. Sci..

[2]  J. A. Tenreiro Machado,et al.  Design of momentum fractional LMS for Hammerstein nonlinear system identification with application to electrically stimulated muscle model , 2019, The European Physical Journal Plus.

[3]  Sham M. Kakade,et al.  Provable Efficient Online Matrix Completion via Non-convex Stochastic Gradient Descent , 2016, NIPS.

[4]  Nick Antonopoulos,et al.  CinemaScreen recommender agent: combining collaborative and content-based filtering , 2006, IEEE Intelligent Systems.

[5]  Ilsun You,et al.  Content Recommendation Algorithm for Intelligent Navigator in Fog Computing Based IoT Environment , 2019, IEEE Access.

[6]  Syed Zubair,et al.  Normalized fractional adaptive methods for nonlinear control autoregressive systems , 2019, Applied Mathematical Modelling.

[7]  Syed Zubair,et al.  A new computing approach for power signal modeling using fractional adaptive algorithms. , 2017, ISA transactions.

[8]  Dietmar Jannach,et al.  News recommender systems - Survey and roads ahead , 2018, Inf. Process. Manag..

[9]  Inderjit S. Dhillon,et al.  Parallel matrix factorization for recommender systems , 2014, Knowl. Inf. Syst..

[10]  Peter J. Haas,et al.  Large-scale matrix factorization with distributed stochastic gradient descent , 2011, KDD.

[11]  Chih-Jen Lin,et al.  A Fast Parallel Stochastic Gradient Method for Matrix Factorization in Shared Memory Systems , 2015, ACM Trans. Intell. Syst. Technol..

[12]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[13]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Metalearning and Recommender Systems: A literature review and empirical study on the algorithm selection problem for Collaborative Filtering , 2018, Inf. Sci..

[14]  Javier Bajo,et al.  Relationship recommender system in a business and employment-oriented social network , 2018, Inf. Sci..

[15]  Bo Wang,et al.  A Survey of Collaborative Filtering-Based Recommender Systems: From Traditional Methods to Hybrid Methods Based on Social Networks , 2018, IEEE Access.

[16]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[17]  J. A. Tenreiro Machado,et al.  Fractional order description of DNA , 2015 .

[18]  Naveed Ishtiaq Chaudhary,et al.  Momentum fractional LMS for power signal parameter estimation , 2018, Signal Process..

[19]  Dennis M. Wilkinson,et al.  Large-Scale Parallel Collaborative Filtering for the Netflix Prize , 2008, AAIM.

[20]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[21]  Yunni Xia,et al.  Applying the learning rate adaptation to the matrix factorization based collaborative filtering , 2013, Knowl. Based Syst..

[22]  Dumitru Baleanu,et al.  Design of sign fractional optimization paradigms for parameter estimation of nonlinear Hammerstein systems , 2019, Neural Computing and Applications.

[23]  Xiaolong Xu,et al.  Privacy-preserving and sparsity-aware location-based prediction method for collaborative recommender systems , 2019, Future Gener. Comput. Syst..

[24]  Shou-De Lin,et al.  A Linear Ensemble of Individual and Blended Models for Music Rating Prediction , 2012, KDD Cup.

[25]  Huma Samin,et al.  Knowledge Based Recommender System for Academia Using Machine Learning: A Case Study on Higher Education Landscape of Pakistan , 2019, IEEE Access.

[26]  Fernando Ortega,et al.  A Collaborative Filtering Approach Based on Naïve Bayes Classifier , 2019, IEEE Access.

[27]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[28]  Chih-Jen Lin,et al.  A Learning-Rate Schedule for Stochastic Gradient Methods to Matrix Factorization , 2015, PAKDD.

[29]  Weiwei Yuan,et al.  HARSAM: A Hybrid Model for Recommendation Supported by Self-Attention Mechanism , 2019, IEEE Access.

[30]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[31]  Mohammadreza Radmanesh,et al.  Hybrid Recommender Systems based on Content Feature Relationship , 2016 .

[32]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[33]  Oliver Hinz,et al.  The value of user’s Facebook profile data for product recommendation generation , 2015, Electron. Mark..

[34]  Qingsheng Zhu,et al.  Incremental Collaborative Filtering recommender based on Regularized Matrix Factorization , 2012, Knowl. Based Syst..

[35]  Thomas Hofmann,et al.  Latent semantic models for collaborative filtering , 2004, TOIS.

[36]  Naveed Ishtiaq Chaudhary,et al.  Design of normalized fractional adaptive algorithms for parameter estimation of control autoregressive autoregressive systems , 2018 .

[37]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[38]  Pekka Toivanen,et al.  Integration of Recommendation Systems Into Connected Health for Effective Management of Chronic Diseases , 2019, IEEE Access.

[39]  Abdon Atangana,et al.  Mathematical analysis of dengue fever outbreak by novel fractional operators with field data , 2019, Physica A: Statistical Mechanics and its Applications.

[40]  Domonkos Tikk,et al.  Scalable Collaborative Filtering Approaches for Large Recommender Systems , 2009, J. Mach. Learn. Res..

[41]  Sebastian Köhler,et al.  The impact of consumer preferences on the accuracy of collaborative filtering recommender systems , 2016, Electronic Markets.

[42]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[43]  Syed Zubair,et al.  Fractional stochastic gradient descent for recommender systems , 2018, Electronic Markets.

[44]  Jason J. Jung,et al.  Multi-Sided recommendation based on social tensor factorization , 2018, Inf. Sci..

[45]  Gil Alterovitz,et al.  Deep Probabilistic Matrix Factorization Framework for Online Collaborative Filtering , 2019, IEEE Access.

[46]  Arun K. Pujari,et al.  Collaborative filtering using multiple binary maximum margin matrix factorizations , 2017, Inf. Sci..

[47]  Abdon Atangana,et al.  Validity of fractal derivative to capturing chaotic attractors , 2019, Chaos, Solitons & Fractals.

[48]  Katrien Verbert,et al.  Interactive recommender systems: A survey of the state of the art and future research challenges and opportunities , 2016, Expert Syst. Appl..

[49]  Fernando Ortega,et al.  Assigning reliability values to recommendations using matrix factorization , 2018, J. Comput. Sci..

[50]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[51]  Tommi S. Jaakkola,et al.  Maximum-Margin Matrix Factorization , 2004, NIPS.

[52]  A. Atangana,et al.  Differential and integral operators with constant fractional order and variable fractional dimension , 2019, Chaos, Solitons & Fractals.

[53]  Yehuda Koren,et al.  Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[54]  Kai Zhang,et al.  Category Preferred Canopy-K-means based Collaborative Filtering algorithm , 2019, Future Gener. Comput. Syst..

[55]  Yan Li,et al.  An innovative fractional order LMS based on variable initial value and gradient order , 2017, Signal Process..

[56]  Chonghuan Xu,et al.  A novel recommendation method based on social network using matrix factorization technique , 2018, Inf. Process. Manag..

[57]  Fernando Ortega,et al.  Robust Model-Based Reliability Approach to Tackle Shilling Attacks in Collaborative Filtering Recommender Systems , 2019, IEEE Access.

[58]  Zhi-Quan Luo,et al.  Guaranteed Matrix Completion via Non-Convex Factorization , 2014, IEEE Transactions on Information Theory.

[59]  Joseph A. Konstan,et al.  Introduction to recommender systems , 2008, SIGMOD Conference.

[60]  Inderjit S. Dhillon,et al.  Scalable Coordinate Descent Approaches to Parallel Matrix Factorization for Recommender Systems , 2012, 2012 IEEE 12th International Conference on Data Mining.