Attentive Stacked Denoising Autoencoder With Bi-LSTM for Personalized Context-Aware Citation Recommendation

The rapid growth of scientific publications brings the problem of finding appropriate citations for authors. Context-aware citation recommendation is an essential technology to overcome this obstacle when given a fragment of manuscript. In this article, we propose a novel neural network model for context-aware citation recommendation by combining stacked denoising autoencoders (SDAE) and Bi-LSTM. To obtain effective embedding for cited paper, we extend SDAE into attentive SDAE (ASDAE) by utilizing the attentive information from citation context, which essentially enhance the learning ability of original SDAE. For citation context, we devise an attentive Bi-LSTM to obtain effective embedding. Specifically, the attentive Bi-LSTM is able to extract suitable citation context and recommend citations simultaneously when given a long text, which is a issue that few papers addressed before. We also integrate personalized author information to improve the performance of recommendation. Our model is essentially a seemly integration of different types of neural network with latent variables. We derive the generative process of our model, and develop a learning algorithm based on maximum a posteriori (MAP) estimation. Experimental results on the RefSeer, ANN and DBLP datasets show that our model outperforms baseline methods.

[1]  Dit-Yan Yeung,et al.  Relational Stacked Denoising Autoencoder for Tag Recommendation , 2015, AAAI.

[2]  Stephen Cranefield,et al.  Context identification of sentences in related work sections using a conditional random field: towards intelligent digital libraries , 2010, JCDL '10.

[3]  Yi Fang,et al.  Neural Citation Network for Context-Aware Citation Recommendation , 2017, SIGIR.

[4]  ChengXiang Zhai,et al.  A Constrained Hidden Markov Model Approach for Non-Explicit Citation Context Extraction , 2014, SDM.

[5]  Zhaohui Wu,et al.  On Deep Learning for Trust-Aware Recommendations in Social Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[6]  James Bailey,et al.  Improving MeSH classification of biomedical articles using citation contexts , 2011, J. Biomed. Informatics.

[7]  Ye Wang,et al.  Improving Content-based and Hybrid Music Recommendation using Deep Learning , 2014, ACM Multimedia.

[8]  Jian Pei,et al.  Citation recommendation without author supervision , 2011, WSDM '11.

[9]  Junwei Han,et al.  Generative Adversarial Network Based Heterogeneous Bibliographic Network Representation for Personalized Citation Recommendation , 2018, AAAI.

[10]  Wenyi Huang,et al.  A Neural Probabilistic Model for Context Based Citation Recommendation , 2015, AAAI.

[11]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[12]  Daniel Kifer,et al.  Context-aware citation recommendation , 2010, WWW '10.

[13]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[14]  Hongfei Yan,et al.  Recommending citations with translation model , 2011, CIKM '11.

[15]  Mohammed J. Zaki,et al.  A Query-oriented Approach for Relevance in Citation Networks , 2016, WWW.

[16]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[17]  Stephen E. Robertson,et al.  Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval , 1994, SIGIR '94.

[18]  Maria Liakata,et al.  Applying Core Scientific Concepts to Context-Based Citation Recommendation , 2016, LREC.

[19]  Jun Zhao,et al.  Recurrent Convolutional Neural Networks for Text Classification , 2015, AAAI.

[20]  Dragomir R. Radev,et al.  The ACL anthology network corpus , 2009, Language Resources and Evaluation.

[21]  Wenjie Li,et al.  A Three-Layered Mutually Reinforced Model for Personalized Citation Recommendation , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[23]  Xiaoming Li,et al.  Personalized Citation Recommendation via Convolutional Neural Networks , 2017, APWeb/WAIM.

[24]  Xiangnan He,et al.  NAIS: Neural Attentive Item Similarity Model for Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[25]  Jun Zhao,et al.  Opinion Target Extraction Using Word-Based Translation Model , 2012, EMNLP.

[26]  Tarun Kumar,et al.  Identifying citing sentences in research papers using supervised learning , 2010, 2010 International Conference on Information Retrieval & Knowledge Management (CAMP).

[27]  Yang Liu,et al.  A Hierarchy-to-Sequence Attentional Neural Machine Translation Model , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[28]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[29]  Petr Knoth,et al.  Using citation-context to reduce topic drifting on pure citation-based recommendation , 2018, RecSys.

[30]  Hugo Larochelle,et al.  Document Neural Autoregressive Distribution Estimation , 2016, J. Mach. Learn. Res..

[31]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[32]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.

[33]  Wenyi Huang,et al.  RefSeer: A citation recommendation system , 2014, IEEE/ACM Joint Conference on Digital Libraries.

[34]  Jing Liu,et al.  News Citation Recommendation with Implicit and Explicit Semantics , 2016, ACL.

[35]  Wenyi Huang,et al.  Recommending citations: translating papers into references , 2012, CIKM.

[36]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[37]  Jiawei Han,et al.  ClusCite: effective citation recommendation by information network-based clustering , 2014, KDD.

[38]  Xiaojun Wan,et al.  Cross-language context-aware citation recommendation in scientific articles , 2014, SIGIR.

[39]  Achim G. Hoffmann,et al.  Summarization based on bi-directional citation analysis , 2015, Inf. Process. Manag..

[40]  Dit-Yan Yeung,et al.  Relational Deep Learning: A Deep Latent Variable Model for Link Prediction , 2017, AAAI.

[41]  Adam Jatowt,et al.  CITEWERTs: A System Combining Cite-Worthiness with Citation Recommendation , 2018, ECIR.

[42]  Kai Chen,et al.  Collaborative filtering and deep learning based recommendation system for cold start items , 2017, Expert Syst. Appl..

[43]  Max Welling,et al.  The Variational Fair Autoencoder , 2015, ICLR.

[44]  Christofer Toumazou,et al.  PERSON—Personalized Expert Recommendation System for Optimized Nutrition , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[45]  Nicholas Jing Yuan,et al.  DRN: A Deep Reinforcement Learning Framework for News Recommendation , 2018, WWW.

[46]  Adam Jatowt,et al.  To Cite, or Not to Cite? Detecting Citation Contexts in Text , 2018, ECIR.

[47]  Yao Lu,et al.  Cross-language Citation Recommendation via Hierarchical Representation Learning on Heterogeneous Graph , 2018, SIGIR.

[48]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[49]  Rabab Kreidieh Ward,et al.  Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[50]  Simone Teufel,et al.  Context-Enhanced Citation Sentiment Detection , 2012, NAACL.