CMIR: A Corpus for Evaluation of Code Mixed Information Retrieval of Hindi-English Tweets

Social media has become almost ubiquitous in present times. Such proliferation leads to automatic information processing need and has various challenges. The nature of social media content is mostly informal. Additionally while talking about Indian social media, users often prefer to use Roman transliterations of their native languages and English embedding. Therefore Information retrieval (IR) on such Indian social media data is a challenging and difficult task when the documents and the queries are a mixture of two or more languages written in either the native scripts and/or in the Roman transliterated form. Here in this paper we have emphasized issues related with Information Retrieval (IR) for Code-Mixed Indian social media texts, particularly texts from twitter. We describe a corpus collection process, reported limitations of available state-of-the-art IR systems on such data and formalize the problem of Code-Mixed Information Retrieval on informal texts.

[1]  Azadeh Shakery,et al.  Multilingual information retrieval in the language modeling framework , 2015, Information Retrieval Journal.

[2]  Björn Gambäck.  On Measuring the Complexity of Code-Mixing , 2014 .

[3]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[4]  Carol Peters,et al.  Multilingual Information Retrieval , 2012, Springer Berlin Heidelberg.

[5]  Monojit Choudhury,et al.  Mining Hindi-English Transliteration Pairs from Online Hindi Lyrics , 2012, LREC.

[6]  Turid Hedlund,et al.  Dictionary-Based Cross-Language Information Retrieval: Problems, Methods, and Research Findings , 2001, Information Retrieval.

[7]  Monojit Choudhury,et al.  Challenges in Designing Input Method Editors for Indian Lan-guages: The Role of Word-Origin and Context , 2011, WTIM@IJCNLP.

[8]  Prasenjit Majumder,et al.  Issues in searching for Indian language web content , 2008, iNEWS '08.

[9]  K. Järvelin,et al.  Cross-Lingual Information Retrieval Problems : Methods and findings for three language pairs , 2002 .

[10]  Amitava Das,et al.  Identifying Languages at the Word Level in Code-Mixed Indian Social Media Text , 2014, ICON.

[11]  Parth Gupta,et al.  Query expansion for mixed-script information retrieval , 2014, SIGIR.

[12]  Carol Peters.  The Impact of Evaluation on Multilingual Information Retrieval System Development , 2006, LREC.

[13]  Brendan T. O'Connor,et al.  Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters , 2013, NAACL.

[14]  Nikos Loutas,et al.  Non-english web search: an evaluation of indexing and searching the Greek web , 2009, Information Retrieval.

[15]  Rohit Arvind Chakrapani,et al.  Transliterated Search of Hindi Lyrics , 2015 .

[16]  A. Kumaran,et al.  Cross-Lingual Information Retrieval System for Indian Languages , 2008, IJCNLP.

[17]  Douglas W. Oard,et al.  CLEF Experiments at Maryland: Statistical Stemming and Backoff Translation , 2000, CLEF.

[18]  Andrei Z. Broder,et al.  Cross-lingual query classification: a preliminary study , 2008, iNEWS '08.

[19]  Anand Arokia Raj,et al.  Transliteration based Search Engine for Multilingual Information Access , 2009 .

[20]  Monojit Choudhury,et al.  Query completion without query logs for song search , 2011, WWW.

[21]  Vasudeva Varma,et al.  Transliteration Based Text Input Methods for Telugu , 2009, ICCPOL.

[22]  Udhyakumar Nallasamy,et al.  Named entity transliteration for cross-language information retrieval using compressed word format mapping algorithm , 2008, iNEWS '08.

[23]  Joachim Wagner,et al.  Code Mixing: A Challenge for Language Identification in the Language of Social Media , 2014, CodeSwitch@EMNLP.