Survey on Answer Validation for Indonesian Question Answering System (IQAS)

Research on Question Answering System (QAS) has been done mainly in English. Unfortunately, for Indonesian, it is still rarely explored whereas Indonesian is the official language used more than 250 million people. Research in the area of Indonesian Question Answering System (IQAS) began in 2005s, and since then only few number of IQAS have been developed. One of the important issues in IQAS is Answer Validation (AV), which is a system that can determine the correctness of QAS. To identify the future scope of research in this area, the need of comprehensive survey on IQAS and AV arises naturally. The goals of this survey are to find the cutting-edge method used in AV and to prove that AV has not been implemented on IQAS. Based on the results, we suggest new opportunities and research challenges for IQAS community.

[1]  Sivaji Bandyopadhyay,et al.  Automatic Answer Validation System on English language , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[2]  Nicole Bauer,et al.  Information Retrieval Implementing And Evaluating Search Engines , 2016 .

[3]  Asep Fajar Firmansyah,et al.  Eliminating Unanswered Questions from Question Answering System for Khulafaa Al-Rashidin History , 2016, 2016 6th International Conference on Information and Communication Technology for The Muslim World (ICT4M).

[4]  Yi Zhang,et al.  Enabling answer validation by logic form reasoning in Chinese question answering , 2003, International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003.

[5]  M. Felisa Verdejo,et al.  The Effect of Entity Recognition in Answer Validation , 2006, CLEF.

[6]  Anselmo Peñas,et al.  A Question Answering System based on Information Retrieval and Validation , 2010, CLEF.

[7]  Mirna Adriani,et al.  Finding Answers to Indonesian Questions from English Documents , 2005, CLEF.

[8]  Alberto Téllez-Valero,et al.  Towards Multi-Stream Question Answering Using Answer Validation , 2010, Informatica.

[9]  M. Felisa Verdejo,et al.  Overview of the Answer Validation Exercise 2007 , 2007, CLEF.

[10]  Ayu Purwarianti,et al.  SISTEM QUESTION ANSWERING BAHASA INDONESIA UNTUK PERTANYAAN NON-FACTOID , 2012 .

[11]  Wiwin Suwarningsih,et al.  Reducing the Conflict Factors Strategies in Question Answering System , 2017 .

[12]  Ayu Purwarianti,et al.  Study and Implementation of Monolingual Approach on Indonesian Question Answering for Factoid and Non-Factoid Question , 2011, PACLIC.

[13]  M. Felisa Verdejo,et al.  Overview of the Answer Validation Exercise 2006 , 2006, CLEF.

[14]  Anne-Laure Ligozat,et al.  Towards an Automatic Validation of Answers in Question Answering , 2007, 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007).

[15]  Mirna Adriani,et al.  Finding Answers Using Resources in the Internet , 2008, CLEF.

[16]  Anselmo Peñas,et al.  On Evaluating the Contribution of Validation for Question Answering , 2015, IEEE Transactions on Knowledge and Data Engineering.

[17]  Ruli Manurung,et al.  Extending an Indonesian Semantic Analysis-based Question Answering System with Linguistic and World Knowledge Axioms , 2008, PACLIC.

[18]  Amit P. Sheth,et al.  RQUERY: Rewriting Natural Language Queries on Knowledge Graphs to Alleviate the Vocabulary Mismatch Problem , 2017, AAAI.

[19]  Ellen M. Voorhees,et al.  Overview of TREC 2003 , 2003, TREC.

[20]  S. D. Larasati.  Towards a Semantic Analysis of Bahasa Indonesia for Question Answering , 2007 .

[21]  Sebastian Padó,et al.  Dependency-Based Answer Validation for German , 2011, CLEF.

[22]  Sanjay K. Dwivedi,et al.  Research and reviews in question answering system , 2013 .

[23]  Sudhir Kumar Sharma,et al.  Sentiment Predictions using Support Vector Machines for Odd-Even Formula in Delhi , 2017 .

[24]  Ayu Purwarianti,et al.  A machine learning approach for indonesian question answering system , 2007, Artificial Intelligence and Applications.

[25]  M. Felisa Verdejo,et al.  Overview of the Answer Validation Exercise 2007 , 2006, CLEF.

[26]  B. Magnini,et al.  Recognizing Textual Entailment with Tree Edit Distance Algorithms , 2005 .

[27]  Óscar Ferrández,et al.  TE4AV: Textual Entailment for Answer Validation , 2008, 2008 International Conference on Natural Language Processing and Knowledge Engineering.

[28]  Robert F. Simmons,et al.  Answering English questions by computer: a survey , 1965, CACM.

[29]  Ingo Glöckner,et al.  An Integrated Machine Learning and Case-Based Reasoning Approach to Answer Validation , 2012, 2012 11th International Conference on Machine Learning and Applications.

[30]  Rakesh Chandra Balabantaray,et al.  Question answering system for factoid based question , 2016, 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I).

[31]  Ido Dagan,et al.  Recognizing Textual Entailment: Models and Applications , 2013, Recognizing Textual Entailment: Models and Applications.

[32]  Darnes Vilariño Ayala,et al.  A Question Answering System for Reading Comprehension Tests , 2013, MCPR.

[33]  Galia Angelova,et al.  Voltron: A Hybrid System For Answer Validation Based On Lexical And Distance Features , 2015, SemEval@NAACL-HLT.

[34]  Amit Mishra,et al.  A survey on question answering systems with classification , 2016, J. King Saud Univ. Comput. Inf. Sci..

[35]  Guiping Zhang,et al.  A Web-based Chinese question answering with answering validation , 2005, 2005 International Conference on Natural Language Processing and Knowledge Engineering.

[36]  A. Purwarianti,et al.  Case based Indonesian closed domain question answering system with real world questions , 2012, 2012 7th International Conference on Telecommunication Systems, Services, and Applications (TSSA).

[37]  Sivaji Bandyopadhyay,et al.  Semantic Answer Validation using Universal Networking Language , 2012 .

[38]  Ayman E. Khedr,et al.  Predicting Stock Market Behavior using Data Mining Technique and News Sentiment Analysis , 2017 .

[39]  Mirna Adriani,et al.  Pattern Based Indonesian Question Answering System , 2009 .

[40]  Alexander Solovyev.  Dependency-Based Algorithms for Answer Validation Task in Russian Question Answering , 2013, GSCL.

[41]  Ayu Purwarianti,et al.  An Indonesian question analyzer to enhance the performance of Indonesian-English CLQA , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[42]  Anne-Laure Ligozat,et al.  Selecting Answers to Questions from Web Documents by a Robust Validation Process , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[43]  Mirna Adriani,et al.  University of indonesia participation at query answering-CLEF 2005 , 2005 .

[44]  Dan I. Moldovan,et al.  Automatic Answer Validation using COGEX , 2006, CLEF.

[45]  Alberto Téllez-Valero,et al.  Improving Question Answering by Combining Multiple Systems Via Answer Validation , 2008, CICLing.

[46]  Asep Fajar Firmansyah,et al.  A rule-based question answering system on relevant documents of Indonesian Quran Translation , 2014, 2014 International Conference on Cyber and IT Service Management (CITSM).

[47]  Van-Tu Nguyen,et al.  Answer Validation for Question Answering Systems by Using External Resources , 2016, IUKM.

[48]  Santosh Kumar Ray,et al.  World Wide Web based Question Answering System - a relevance feedback framework for automatic answer validation , 2009, 2009 Second International Conference on the Applications of Digital Information and Web Technologies.