DLTSR: A Deep Learning Framework for Recommendations of Long-Tail Web Services

With the growing popularity of web services, more and more developers are composing multiple services into mashups. Developers show an increasing interest in non-popular services (i.e., long-tail ones), however, there are very scarce studies trying to address the long-tail web service recommendation problem. The major challenges for recommending long-tail services accurately include severe sparsity of historical usage data and unsatisfactory quality of description content. In this paper, we propose to build a deep learning framework to address these challenges and perform accurate long-tail recommendations. To tackle the problem of unsatisfactory quality of description content, we use stacked denoising autoencoders (SDAE) to perform feature extraction. Additionally, we impose the usage records in hot services as a regularization of the encoding output of SDAE, to provide feedback to content extraction. To address the sparsity of historical usage data, we learn the patterns of developers’ preference instead of modeling individual services. Our experimental results on a real-world dataset demonstrate that, with such joint autoencoder based feature representation and content-usage learning framework, the proposed algorithm outperforms the state-of-the-art baselines significantly.

[1]  M. Brian Blake,et al.  Service-Oriented Computing and Cloud Computing: Challenges and Opportunities , 2010, IEEE Internet Computing.

[2]  Matt J. Kusner,et al.  From Word Embeddings To Document Distances , 2015, ICML.

[3]  Xumin Liu,et al.  Incorporating User, Topic, and Service Related Latent Factors into Web Service Recommendation , 2015, 2015 IEEE International Conference on Web Services.

[4]  Qi Yu,et al.  Aggregating Functionality, Use History, and Popularity of APIs to Recommend Mashup Creation , 2015, ICSOC.

[5]  Junjie Yao,et al.  Challenging the Long Tail Recommendation , 2012, Proc. VLDB Endow..

[6]  Cheng Wu,et al.  Category-Aware API Clustering and Distributed Recommendation for Automatic Mashup Creation , 2015, IEEE Transactions on Services Computing.

[7]  Shangguang Wang,et al.  Predicting QoS Values via Multi-dimensional QoS Data for Web Service Recommendations , 2015, 2015 IEEE International Conference on Web Services.

[8]  Christoph Schroth,et al.  Web 2.0 and SOA: Converging Concepts Enabling the Internet of Services , 2007, IT Professional.

[9]  Hsin-Hsi Chen,et al.  Weighted matrix factorization for spoken document retrieval , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Jinpeng Huai,et al.  A Probabilistic Approach for Web Service Discovery , 2013, 2013 IEEE International Conference on Services Computing.

[11]  Mehran Sahami,et al.  Text Mining: Classification, Clustering, and Applications , 2009 .

[12]  Jia Zhang,et al.  Time-Aware Service Recommendation for Mashup Creation , 2015, IEEE Transactions on Services Computing.

[13]  Alexander Tuzhilin,et al.  The long tail of recommender systems and how to leverage it , 2008, RecSys '08.

[14]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[15]  Xiaohui Hu,et al.  A Time-Aware and Data Sparsity Tolerant Approach for Web Service Recommendation , 2014, 2014 IEEE International Conference on Web Services.

[16]  Nitish Srivastava,et al.  Modeling Documents with Deep Boltzmann Machines , 2013, UAI.

[17]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[18]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[19]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[20]  Nitish Srivastava,et al.  Modeling Documents with Deep Boltzmann Machines , 2013, UAI.

[21]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[22]  Chhavi Rana,et al.  Diversity in Recommender System , 2013 .

[23]  Sida I. Wang,et al.  Dropout Training as Adaptive Regularization , 2013, NIPS.

[24]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[25]  Hailong Sun,et al.  Temporal QoS-aware web service recommendation via non-negative tensor factorization , 2014, WWW.

[26]  Pascal Vincent,et al.  Generalized Denoising Auto-Encoders as Generative Models , 2013, NIPS.

[27]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[28]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[29]  David M. Blei,et al.  Hierarchical relational models for document networks , 2009, 0909.4331.

[30]  Hailong Sun,et al.  A Novel Approach for API Recommendation in Mashup Development , 2014, 2014 IEEE International Conference on Web Services.

[31]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Rob Hall,et al.  Style in the long tail: discovering unique interests with latent variable models in large scale social E-commerce , 2014, KDD.

[33]  Jia Zhang,et al.  Recommend-As-You-Go: A Novel Approach Supporting Services-Oriented Scientific Workflow Reuse , 2011, 2011 IEEE International Conference on Services Computing.

[34]  Bing Bai,et al.  Service Recommendation for Mashup Creation Based on Time-Aware Collaborative Domain Regression , 2015, 2015 IEEE International Conference on Web Services.

[35]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[36]  Wei Chen,et al.  Opinion-Based Collaborative Filtering to Solve Popularity Bias in Recommender Systems , 2013, DEXA.

[37]  Zibin Zheng,et al.  Collaborative Web Service QoS Prediction via Neighborhood Integrated Matrix Factorization , 2013, IEEE Transactions on Services Computing.