Graph-based biomedical text summarization: An itemset mining and sentence clustering approach

OBJECTIVE Automatic text summarization offers an efficient solution to access the ever-growing amounts of both scientific and clinical literature in the biomedical domain by summarizing the source documents while maintaining their most informative contents. In this paper, we propose a novel graph-based summarization method that takes advantage of the domain-specific knowledge and a well-established data mining technique called frequent itemset mining. METHODS Our summarizer exploits the Unified Medical Language System (UMLS) to construct a concept-based model of the source document and mapping the document to the concepts. Then, it discovers frequent itemsets to take the correlations among multiple concepts into account. The method uses these correlations to propose a similarity function based on which a represented graph is constructed. The summarizer then employs a minimum spanning tree based clustering algorithm to discover various subthemes of the document. Eventually, it generates the final summary by selecting the most informative and relative sentences from all subthemes within the text. RESULTS We perform an automatic evaluation over a large number of summaries using the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) metrics. The results demonstrate that the proposed summarization system outperforms various baselines and benchmark approaches. CONCLUSION The carried out research suggests that the incorporation of domain-specific knowledge and frequent itemset mining equips the summarization system in a better way to address the informativeness measurement of the sentences. Moreover, clustering the graph nodes (sentences) can enable the summarizer to target different main subthemes of a source document efficiently. The evaluation results show that the proposed approach can significantly improve the performance of the summarization systems in the biomedical domain.

[1]  Mohamed Abdel Fattah A hybrid machine learning model for multi-document summarization , 2013, Applied Intelligence.

[2]  Xiaojun Wan,et al.  Recent advances in document summarization , 2017, Knowledge and Information Systems.

[3]  Ani Nenkova,et al.  Automatic Summarization , 2011, ACL.

[4]  Pablo Gervás,et al.  A semantic graph-based approach to biomedical summarisation , 2011, Artif. Intell. Medicine.

[5]  H. P. Edmundson,et al.  New Methods in Automatic Extracting , 1969, JACM.

[6]  Halil Kilicoglu,et al.  Automatic summarization of MEDLINE citations for evidence-based medical treatment: A topic-oriented evaluation , 2009, J. Biomed. Informatics.

[7]  David Camacho,et al.  A genetic graph-based clustering approach to biomedical summarization , 2013, WIMS '13.

[8]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[9]  Hans Peter Luhn,et al.  The Automatic Creation of Literature Abstracts , 1958, IBM J. Res. Dev..

[10]  Jian Pei,et al.  Mining frequent patterns without candidate generation , 2000, SIGMOD 2000.

[11]  Lucas Antiqueira,et al.  A complex network approach to text summarization , 2009, Inf. Sci..

[12]  Jorge Carrillo de Albornoz,et al.  Evaluating the use of different positional strategies for sentence selection in biomedical literature summarization , 2012, BMC Bioinformatics.

[13]  Halil Kilicoglu,et al.  Abstraction Summarization for Managing the Biomedical Research Literature , 2004, HLT-NAACL 2004.

[14]  Laura Plaza Comparing different knowledge sources for the automatic summarization of biomedical literature , 2014, J. Biomed. Informatics.

[15]  Lisa F. Rau,et al.  Automatic Condensation of Electronic Publications by Sentence Selection , 1995, Inf. Process. Manag..

[16]  W. Alkema,et al.  Application of text mining in the biomedical domain. , 2015, Methods.

[17]  Jinwoo Park,et al.  Automatic Text Categorization using the Importance of Sentences , 2002, COLING.

[18]  Peng Shi,et al.  Enhancing sentence-level clustering with ranking-based clustering framework for theme-based summarization , 2014, Inf. Sci..

[19]  Sanda M. Harabagiu,et al.  Topic themes for multi-document summarization , 2005, SIGIR '05.

[20]  Xiaohua Hu,et al.  A coherent graph-based semantic clustering and summarization approach for biomedical literature and a new summarization evaluation method , 2007, BMC Bioinformatics.

[21]  Nikolaos G. Bourbakis,et al.  Graph-Based Methods for Natural Language Processing and Understanding—A Survey and Analysis , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Karen Spärck Jones Automatic summarising: The state of the art , 2007, Inf. Process. Manag..

[23]  Xindong Wu,et al.  Multi-document summarization using closed patterns , 2016, Knowl. Based Syst..

[24]  Luca Cagliero,et al.  GraphSum: Discovering correlations among multiple terms for graph-based summarization , 2013, Inf. Sci..

[25]  Dongwook Shin,et al.  Degree centrality for semantic abstraction summarization of therapeutic studies , 2011, J. Biomed. Informatics.

[26]  Hyoil Han,et al.  BioChain: lexical chaining methods for biomedical text summarization , 2006, SAC.

[27]  Vishal Gupta,et al.  Recent automatic text summarization techniques: a survey , 2016, Artificial Intelligence Review.

[28]  Elizabeth León Guzman,et al.  Extractive single-document summarization based on genetic operators and guided local search , 2014, Expert Syst. Appl..

[29]  M. Owen,et al.  Genomic insights into the overlap between psychiatric disorders: implications for research and clinical practice , 2014, Genome Medicine.

[30]  Horacio Saggion A Robust and Adaptable Summarization Tool , 2008 .

[31]  Panagiotis Stamatopoulos,et al.  Summarization from Medical Documents: A Survey , 2005, Artif. Intell. Medicine.

[32]  Hyoil Han,et al.  The use of domain-specific concepts in biomedical text summarization , 2007, Inf. Process. Manag..

[33]  Milad Moradi,et al.  Quantifying the informativeness for biomedical literature summarization: An itemset mining method , 2016, Comput. Methods Programs Biomed..

[34]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[35]  Dongwook Shin,et al.  Clustering cliques for graph-based summarization of the biomedical research literature , 2013, BMC Bioinformatics.

[36]  C. Ordonez,et al.  Constraining and summarizing association rules in medical data , 2006 .

[37]  Gurpreet Singh Lehal,et al.  A Survey of Text Summarization Extractive Techniques , 2010 .

[38]  Guilherme Del Fiol,et al.  Text summarization in the biomedical domain: A systematic review of recent research , 2014, J. Biomed. Informatics.

[39]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[40]  Luca Cagliero,et al.  Multi-document summarization exploiting frequent itemsets , 2012, SAC '12.

[41]  Khushbu Saraf,et al.  Improving graph based multidocument text summarization using an enhanced sentence similarity measure , 2015, 2015 IEEE 2nd International Conference on Recent Trends in Information Systems (ReTIS).

[42]  Xijin Tang,et al.  Text clustering using frequent itemsets , 2010, Knowl. Based Syst..

[43]  Youngjoong Ko,et al.  An effective sentence-extraction technique using contextual information and statistical approaches for text summarization , 2008, Pattern Recognition Letters.

[44]  ELENA BARALIS,et al.  MWI-Sum: A Multilingual Summarizer Based on Frequent Weighted Itemsets , 2015, TOIS.

[45]  R. Mitkov The Oxford Handbook of Computational Linguistics (Oxford Handbooks) , 2003 .

[46]  Karen Sparck Jones,et al.  Book Reviews: Evaluating Natural Language Processing Systems: An Analysis and Review , 1996, CL.

[47]  Wai Lam,et al.  Evaluation Challenges in Large-Scale Document Summarization , 2003, ACL.

[48]  Dina Demner-Fushman,et al.  Biomedical Text Mining: A Survey of Recent Progress , 2012, Mining Text Data.

[49]  Elena Lloret,et al.  Text summarisation in progress: a literature review , 2011, Artificial Intelligence Review.

[50]  Dragomir R. Radev,et al.  LexRank: Graph-based Lexical Centrality as Salience in Text Summarization , 2004, J. Artif. Intell. Res..

[51]  Olivier Bodenreider,et al.  The Unified Medical Language System (UMLS): integrating biomedical terminology , 2004, Nucleic Acids Res..