An automatic question answering and knowledge summarization approach for Q&A services

Abstract With regard to the drastic development of information technologies, the communication channels between enterprises and customers have become more and more complicated. Many enterprises have realized that electronic CRM mechanisms can provide efficient and cost‐effective customer services. In order to automatically answer customer queries via contact centers, this paper proposes an integrated model with automatic question answering and knowledge summarization mechanisms. The integrated model consists of six main phases including keyword distribution analysis, question correlation analysis, meaning unit (MU) analysis, information intensity analysis, MU correlation analysis and MU linkage. The basic idea of the model is to explore the correlation between the target question and FAQs based on their keyword distribution. According to the derived correlation, the candidate answers of the target question can be determined. Furthermore, based on the information intensity of MUs in the candidate answers, critical MUs are extracted and linked to derive the summarized answer to the target question. A web‐based platform is established and the proposed approach is evaluated via an LSP e‐training case. By application of the automatic question answering mechanism, interaction relationships between users and e‐platforms can be improved. The proposed model can be incorporated into CRM, e‐training, or knowledge management systems for efficient question answering and accurate information retrieval.

[1]  Lee-Feng Chien,et al.  PAT-tree-based keyword extraction for Chinese information retrieval , 1997, SIGIR '97.

[2]  Dragomir R. Radev,et al.  Question-answering by predictive annotation , 2000, SIGIR '00.

[3]  Yorick Wilks,et al.  Information Extraction: Beyond Document Retrieval , 1998, Int. J. Comput. Linguistics Chin. Lang. Process..

[4]  Hans Peter Luhn,et al.  The Automatic Creation of Literature Abstracts , 1958, IBM J. Res. Dev..

[5]  Julio Gonzalo,et al.  Interactive question answering: Is Cross-Language harder than monolingual searching? , 2008, Inf. Process. Manag..

[6]  Douglas E. Appelt,et al.  Introduction to Information Extraction Technology , 1999, IJCAI 1999.

[7]  James Allan,et al.  Temporal summaries of new topics , 2001, SIGIR '01.

[8]  Dwayne Whitten,et al.  A Meta-Analysis of Emerging Infomediary Knowledge Management Systems: An Expert Systems Application in the E-Tailing Environment , 2002, J. Comput. Inf. Syst..

[9]  Douglas E. Appelt,et al.  Introduction to Information Extraction , 1999, AI Commun..

[10]  M.-T. Sun,et al.  An Intelligent Knowledge Management Model for Construction and Reuse of Automobile Manufacturing Intellectual Properties , 2005 .

[11]  H. P. Edmundson,et al.  New Methods in Automatic Extracting , 1969, JACM.

[12]  Pi,et al.  An automatic question answering platform for Q&A services of logistics service providers," , 2006 .

[13]  Sanda M. Harabagiu,et al.  LASSO: A Tool for Surfing the Answer Net , 1999, TREC.

[14]  Jiang-Liang Hou,et al.  Heuristic and integrated approach for technical document authority and authentication sequence determination , 2004 .

[15]  Regina Barzilay,et al.  Using Lexical Chains for Text Summarization , 1997 .

[16]  Gideon S. Mann,et al.  Analyses for elucidating current question answering technology , 2001, Natural Language Engineering.

[17]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[18]  Susan T. Dumais,et al.  Personalized information delivery: an analysis of information filtering methods , 1992, CACM.

[19]  Kam-Fai Wong,et al.  KPS: a Web Information Mining Algorithm , 1999, Comput. Networks.

[20]  Robert J. Gaizauskas,et al.  Using Coreference Chains for Text Summarization , 1999, COREF@ACL.

[21]  Tiecheng Liu,et al.  Summarization of Visual Content in Instructional Videos , 2007, IEEE Transactions on Multimedia.

[22]  Jiang-Liang Hou,et al.  A hierarchical classification mechanism for organization document management , 2006 .

[23]  Djemel Ziou,et al.  Image Collection Organization and Its Application to Indexing, Browsing, Summarization, and Semantic Retrieval , 2007, IEEE Transactions on Multimedia.

[24]  David C. Yen,et al.  Internet Integrated Customer Relationship Management a Key Success Factor for Companies in the E-Commerce Arena , 2002, J. Comput. Inf. Syst..

[25]  Gerard Salton,et al.  A vector space model for automatic indexing , 1975, CACM.

[26]  Jiang-Liang Hou,et al.  A mobile knowledge carrier with personalized knowledge provision , 2006, Comput. Ind. Eng..

[27]  Guizhong Liu,et al.  A Multiple Visual Models Based Perceptive Analysis Framework for Multilevel Video Summarization , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Yueh-Min Huang,et al.  An intelligent human-expert forum system based on fuzzy information retrieval technique , 2008, Expert Syst. Appl..

[29]  Lynette Hirschman,et al.  Natural language question answering: the view from here , 2001, Natural Language Engineering.

[30]  Vijay V. Raghavan,et al.  Information Retrieval on the World Wide Web , 1997, IEEE Internet Comput..

[31]  Fong-Jung Yu,et al.  A Knowledge Component Analysis Model Based on Term Frequency and Correlation Analysis , 2006, J. Comput. Inf. Syst..

[32]  R.E. Filman,et al.  Searching the Internet , 1998, IEEE Internet Computing.

[33]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[34]  Wen-Lian Hsu,et al.  Question Classification in English-Chinese Cross-Language Question Answering: An Integrated Genetic Algorithm and Machine Learning Approach , 2007, 2007 IEEE International Conference on Information Reuse and Integration.

[35]  Kristian J. Hammond,et al.  FAQ finder: a case-based approach to knowledge navigation , 1995, Proceedings the 11th Conference on Artificial Intelligence for Applications.

[36]  Ilan Greenberg,et al.  Searching for New Search Technologies , 1999, Computer.

[37]  Chun-Min Huang,et al.  Design and Implement Hierarchical Topic Knowledge Map for Chinese News with Multi-Document Summarization , 2006 .

[38]  Jiang-Liang Hou,et al.  A Document and User Matching Model via Document Keyword Analysis , 2004, J. Comput. Inf. Syst..

[39]  Chang-Shing Lee,et al.  Ontology-based fuzzy event extraction agent for Chinese e-news summarization , 2003, Expert Syst. Appl..

[40]  Berlin Chen,et al.  Extractive spoken document summarization for information retrieval , 2008, Pattern Recognit. Lett..

[41]  Mohammadreza Rezailashkajani,et al.  A web-based patient education system and self-help group in Persian language for inflammatory bowel disease patients , 2008, Int. J. Medical Informatics.

[42]  Vibhu O. Mittal,et al.  Bridging the lexical chasm: statistical approaches to answer-finding , 2000, SIGIR '00.