Anti-negation method for handling negation words in question answering system

The question answer (QA) system for a reading comprehension task tries to answer the question by retrieving the needed phrase from the given content. Precise answering is the key role of a QA system. An ambiguity is developed when we need to answer a negative question with a positive reply. The negation words change the polarity of the sentence, and hence, the scope of negation words is notable. This has paved the way for studying the role of ‘negation’ in the natural language processing (NLP) task. The handling of these words is considered a major part of our proposed methodology. In this paper, we propose an algorithm to retrieve and replace the negation words present in the content and query. A comparative study is done for performing word embedding over these words using various state-of-the-art methods. In earlier works when handling the negation the semantics of the sentences are changed. Hence, in this paper we try to maintain the semantics through our proposed methodology. The updated content is embedded into the bi-directional long short-term memory (Bi-LSTM) and thus makes the retrieving of an answer for a question answer system easier. The proposed work has been carried over the Stanford Negation, and the SQuAD dataset with a higher precision value of 96.2% has been achieved in retrieving the answers that are given in the dataset.

[1]  Jacqueline Bourdeau,et al.  Advances in Intelligent Tutoring Systems , 2010 .

[2]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[3]  Jian Zhang,et al.  SQuAD: 100,000+ Questions for Machine Comprehension of Text , 2016, EMNLP.

[4]  Geraldo Xexéo,et al.  Word Embeddings: A Survey , 2019, ArXiv.

[5]  H. Gruet-Skrabalova Yes or no, or how to answer a negative question , 2016 .

[6]  G. Pullum,et al.  The Cambridge Grammar of the English Language , 2002 .

[7]  K VENINGSTON,et al.  Semantic association ranking schemes for information retrieval applications using term association graph representation , 2015 .

[8]  Yang Xiang,et al.  Answer Selection in Community Question Answering via Attentive Neural Networks , 2017, IEEE Signal Processing Letters.

[9]  Bo Liu,et al.  Support Vector Machines for Text Categorization in Chinese Question Classification , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[10]  José Camacho-Collados,et al.  From Word to Sense Embeddings: A Survey on Vector Representations of Meaning , 2018, J. Artif. Intell. Res..

[11]  Mitesh M. Khapra,et al.  DuoRC: Towards Complex Language Understanding with Paraphrased Reading Comprehension , 2018, ACL.

[12]  Tom Arodz,et al.  word2ket: Space-efficient Word Embeddings inspired by Quantum Entanglement , 2020, ICLR.

[13]  Dale Schuurmans,et al.  On the Global Convergence Rates of Softmax Policy Gradient Methods , 2020, ICML.

[14]  Mustafa Mat Deris,et al.  Effect of negation in sentiment analysis , 2016, 2016 Sixth International Conference on Innovative Computing Technology (INTECH).

[15]  Mohammed Kaity,et al.  An integrated semi-automated framework for domain-based polarity words extraction from an unannotated non-English corpus , 2020, The Journal of Supercomputing.

[16]  James J. Masanz,et al.  Negation’s Not Solved: Generalizability Versus Optimizability in Clinical Natural Language Processing , 2014, PloS one.

[17]  Laurence R. Horn A Natural History of Negation , 1989 .

[18]  Wendy W. Chapman,et al.  ConText: An Algorithm for Identifying Contextual Features from Clinical Text , 2007, BioNLP@ACL.

[19]  Li Rumeng,et al.  A hybrid Neural Network Model for Joint Prediction of Presence and Period Assertions of Medical Events in Clinical Notes. , 2017, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[20]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[21]  Karthick Seshadri,et al.  A distributed parallel algorithm for inferring hierarchical groups from large‐scale text corpuses , 2018, Concurr. Comput. Pract. Exp..

[22]  Bonnie L. Webber,et al.  Neural Networks For Negation Scope Detection , 2016, ACL.

[23]  Elly van Munster The treatment of scope and negation in Rosetta , 1988, COLING.

[24]  Zuhair Bandar,et al.  Sentence similarity based on semantic nets and corpus statistics , 2006, IEEE Transactions on Knowledge and Data Engineering.

[25]  Jonas Mueller,et al.  Siamese Recurrent Architectures for Learning Sentence Similarity , 2016, AAAI.

[26]  Dietrich Klakow,et al.  A survey on the role of negation in sentiment analysis , 2010, NeSp-NLP@ACL.

[27]  Busra Celikkaya,et al.  Joint Entity Extraction and Assertion Detection for Clinical Text , 2018, ACL.

[28]  Alok N. Choudhary,et al.  Sentiment Analysis of Conditional Sentences , 2009, EMNLP.

[29]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[30]  Felipe Meneguzzi,et al.  Measuring Semantic Similarity Between Sentences Using A Siamese Neural Network , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[31]  Daniel L. Rubin,et al.  Evaluation of Negation and Uncertainty Detection and its Impact on Precision and Recall in Search , 2009, Journal of Digital Imaging.

[32]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[33]  Ulrike Hahn,et al.  Cancellation, negation, and rejection , 2019, Cognitive Psychology.

[34]  Yacine Ouzrout,et al.  Negation Handling in Sentiment Analysis at Sentence Level , 2017, J. Comput..

[35]  Steven Bethard,et al.  Does BERT need domain adaptation for clinical negation detection? , 2020, J. Am. Medical Informatics Assoc..

[36]  Ernestina Menasalvas,et al.  Spa-neg: An Approach for Negation Detection in Clinical Text Written in Spanish , 2020 .

[37]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[38]  Dan I. Moldovan,et al.  Some Issues on Detecting Negation from Text , 2011, FLAIRS.

[39]  Oren Etzioni,et al.  Extracting Product Features and Opinions from Reviews , 2005, HLT.

[40]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[41]  Leo Anthony Celi,et al.  Introduction to Clinical Natural Language Processing with Python , 2020, Leveraging Data Science for Global Health.

[42]  Long Chen,et al.  Attention-Based Deep Learning System for Negation and Assertion Detection in Clinical Notes , 2019, International Journal of Artificial Intelligence & Applications.

[43]  Saidah Saad,et al.  Question answering system supporting vector machine method for hadith domain , 2017 .

[44]  Christopher D. Manning,et al.  Finding Contradictions in Text , 2008, ACL.

[45]  Gerard Salton,et al.  A vector space model for automatic indexing , 1975, CACM.

[46]  Carolyn Penstein Rosé,et al.  A Hybrid Text Classification Approach for Analysis of Student Essays , 2003, HLT-NAACL 2003.

[47]  Mitesh M. Khapra,et al.  Towards Exploiting Background Knowledge for Building Conversation Systems , 2018, EMNLP.