Phraseformer: Multimodal Key-phrase Extraction using Transformer and Graph Embedding

Background Keyword extraction is a popular research topic in the field of natural language processing.

[1]  Ahmed A. Rafea,et al.  KP-Miner: A keyphrase extraction system for English and Arabic documents , 2009, Inf. Syst..

[2]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[3]  Cornelia Caragea,et al.  Bi-LSTM-CRF Sequence Labeling for Keyphrase Extraction from Scholarly Documents , 2019, WWW.

[4]  Senja Pollak,et al.  TNT-KID: Transformer-based Neural Tagger for Keyword Identification , 2021, Natural Language Engineering.

[5]  Driss Mammass,et al.  A Graph-Based Ranking Model for Automatic Keyphrases Extraction from Arabic Documents , 2017, ICDM.

[6]  Cina Motamed,et al.  CWI: A multimodal deep learning approach for named entity recognition from social media using character, word and image features , 2020, Neural Computing and Applications.

[7]  Abraham Kandel,et al.  DegExt - A Language-Independent Graph-Based Keyphrase Extractor , 2011, AWIC.

[8]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[9]  Junhee Seok,et al.  Validation of deep learning natural language processing algorithm for keyword extraction from pathology reports in electronic health records , 2020, Scientific Reports.

[10]  Priyanka Gandhi,et al.  Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERT , 2019, ArXiv.

[11]  Jingjing Wang,et al.  Using Convolutional Neural Networks to Extract Keywords and Keyphrases: A Case Study for Foodborne Illnesses , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[12]  Fabrice Alizon,et al.  Keyword extraction: Issues and methods , 2019, Natural Language Engineering.

[13]  Evangelos E. Milios,et al.  A multi-centrality index for graph-based keyword extraction , 2019, Inf. Process. Manag..

[14]  Roger Zimmermann,et al.  Keyphrase Extraction from Scholarly Articles as Sequence Labeling using Contextualized Embeddings , 2019, ArXiv.

[15]  Florian Boudin,et al.  TopicRank: Graph-Based Topic Ranking for Keyphrase Extraction , 2013, IJCNLP.

[16]  Minh-Thang Luong,et al.  WINGNUS: Keyphrase Extraction Utilizing Document Logical Structure , 2010, *SEMEVAL.

[17]  Rada Mihalcea,et al.  TextRank: Bringing Order into Text , 2004, EMNLP.

[18]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[19]  Julian M. Kupiec,et al.  Robust part-of-speech tagging using a hidden Markov model , 1992 .

[20]  Xiaoli Li,et al.  MIKE: Keyphrase Extraction by Integrating Multidimensional Information , 2017, CIKM.

[21]  Georg Groh,et al.  Sequence Labeling: A Practical Approach , 2018, ArXiv.

[22]  Florian Boudin,et al.  Unsupervised Keyphrase Extraction with Multipartite Graphs , 2018, NAACL.

[23]  Alec Radford,et al.  Improving Language Understanding by Generative Pre-Training , 2018 .

[24]  G. Fitzgerald,et al.  'I. , 2019, Australian journal of primary health.

[25]  Anette Hulth,et al.  Improved Automatic Keyword Extraction Given More Linguistic Knowledge , 2003, EMNLP.

[26]  Isabelle Augenstein,et al.  SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publications , 2017, *SEMEVAL.

[27]  E. Cambria,et al.  Deep Learning--based Text Classification , 2020, ACM Comput. Surv..

[28]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[29]  Cornelia Caragea,et al.  PositionRank: An Unsupervised Approach to Keyphrase Extraction from Scholarly Documents , 2017, ACL.

[30]  Michael W. Berry,et al.  Text mining : applications and theory , 2010 .

[31]  James H. Martin,et al.  SGRank: Combining Statistical and Graphical Methods to Improve the State of the Art in Unsupervised Keyphrase Extraction , 2015, *SEMEVAL.

[32]  Roger Zimmermann,et al.  Key2Vec: Automatic Ranked Keyphrase Extraction from Scientific Articles using Phrase Embeddings , 2018, NAACL.

[33]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[34]  Nick Cramer,et al.  Automatic Keyword Extraction from Individual Documents , 2010 .

[35]  Wei Wei,et al.  A Survey on Recent Advances in Sequence Labeling from Deep Learning Models , 2020, ArXiv.

[36]  Beibei Wang,et al.  Detecting Hot Topics From Academic Big Data , 2019, IEEE Access.

[37]  Aditi Sharan,et al.  Keyword and Keyphrase Extraction Techniques: A Literature Review , 2015 .

[38]  Chengzhi Zhang,et al.  Automatic Keyword Extraction from Documents Using Conditional Random Fields , 2008 .

[39]  Michalis Vazirgiannis,et al.  A Graph Degeneracy-based Approach to Keyword Extraction , 2016, EMNLP.

[40]  Yiming Yang,et al.  XLNet: Generalized Autoregressive Pretraining for Language Understanding , 2019, NeurIPS.

[41]  Timothy Baldwin,et al.  SemEval-2010 Task 5 : Automatic Keyphrase Extraction from Scientific Articles , 2010, *SEMEVAL.

[42]  Leandro Nunes de Castro,et al.  A keyword extraction method from twitter messages represented as graphs , 2014, Appl. Math. Comput..

[43]  Shibamouli Lahiri,et al.  Keywords at Work: Investigating Keyword Extraction in Social Media Applications , 2018 .

[44]  Xiaojun Wan,et al.  CollabRank: Towards a Collaborative Approach to Single-Document Keyphrase Extraction , 2008, COLING.

[45]  Cina Motamed,et al.  ExEm: Expert Embedding using dominating set theory with deep learning approaches , 2020, Expert Syst. Appl..

[46]  Brahim Ouhbi,et al.  Automatic keyphrase extraction: a survey and trends , 2019, Journal of Intelligent Information Systems.

[47]  Cina Motamed,et al.  BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer , 2020, ArXiv.

[48]  John R. Talburt,et al.  Theme-Weighted Ranking of Keywords from Text Documents Using Phrase Embeddings , 2018, 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).

[49]  Özlem Ünlü Kılıç,et al.  A Survey on Keyword and Key Phrase Extraction with Deep Learning , 2019, 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT).

[50]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[51]  Grigorios Tsoumakas,et al.  A review of keyphrase extraction , 2019, WIREs Data Mining Knowl. Discov..

[52]  Marco Basaldella,et al.  Bidirectional LSTM Recurrent Neural Network for Keyphrase Extraction , 2018, IRCDL.

[53]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[54]  Abdelghani Bellaachia,et al.  NE-Rank: A Novel Graph-Based Keyphrase Extraction in Twitter , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[55]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[56]  Philip Calvert,et al.  Design and Usability of Digital Libraries: Case Studies in the Asia Pacific , 2005 .

[57]  Ricardo Campos,et al.  YAKE! Keyword extraction from single documents using multiple local features , 2020, Inf. Sci..

[58]  Mohammad-Reza Feizi-Derakhshi,et al.  TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection , 2020, ArXiv.

[59]  Florian Boudin,et al.  A Comparison of Centrality Measures for Graph-Based Keyphrase Extraction , 2013, IJCNLP.