Overview of CLIR Task at the Fourth NTCIR Workshop

The purpose of this paper is to overview research efforts at the NTCIR-6 CLIR task, which is a project of large-scale retrieval experiments on cross-lingual information retrieval (CLIR) of Chinese, Japanese, Korean, and English. The project has three sub-tasks, multi-lingual IR (MLIR), bilingual IR (BLIR), and single language IR (SLIR), in which many research groups from ten countries or regions are participating. This paper describes the system of the NTCIR-6 CLIR task and its test collection (document sets, topic sets, and method for relevance judgments), and reviews CLIR techniques used by participants and search performance of runs submitted for evaluation.

[1]  Ying Zhang,et al.  Using the Web for Translation Disambiguation: RMIT University at NTCIR-5 Chinese-English CLIR , 2005, NTCIR.

[2]  Yiming Yang,et al.  Cross-Lingual Pseudo-Relevance Feedback Using a Comparable Corpus , 2001, CLEF.

[3]  Jong-Hyeok Lee,et al.  Combination Approaches in Information Retrieval: Words vs. N-grams and Query Translation vs. Document Translation , 2006, NTCIR.

[4]  Sun Yu-fang,et al.  Applying Language Model into IR Task , 2004 .

[5]  Maarten de Rijke,et al.  The University of Amsterdam at NTCIR-5 , 2005, NTCIR.

[6]  Masaki Murata,et al.  Applying Multiple Characteristics and Techniques in the NICT Information Retrieval System in NTCIR-5 , 2005, NTCIR.

[7]  Yue Xu,et al.  NTCIR-5 CLIR Experiments at QUT , 2005, NTCIR.

[8]  Ying Zhang,et al.  RMIT Chinese-English CLIR at NTCIR-4 , 2004, NTCIR.

[9]  Tetsuya Sakai,et al.  Toshiba BRIDJE at NTCIR-4 CLIR: Monolingual/Bilingual IR and Flexible Feedback , 2004, NTCIR.

[10]  Hsin-Hsi Chen,et al.  Overview of CLIR Task at the Third NTCIR Workshop , 2002, NTCIR.

[11]  Jacques Savoy.  Report on CLIR Task for the NTCIR-4 Evaluation Campaign , 2004, NTCIR.

[12]  Sumio Fujita,et al.  Notes on Phrasal Indexing: JSCB Evaluation Experiments at NTCIR AD HOC , 1999, NTCIR.

[13]  Sora Choi,et al.  NTCIR-5 Chinese, English, Korean Cross Language Retrieval Experiments using PIRCS , 2005, NTCIR.

[14]  Junlin Zhang,et al.  ISCAS in English-Chinese CLIR at NTCIR-5 , 2005, NTCIR.

[15]  Fredric C. Gey.  How Similar are Chinese and Japanese for Cross-Language Information Retrieval? , 2005, NTCIR.

[16]  Noriko Kando.  Overview of the Second NTCIR Workshop , 2001, NTCIR.

[17]  Jong-Hyeok Lee,et al.  POSTECH at NTCIR-5: Combining Evidences of Multiple Term Extractions for Mono-lingual and Cross-lingual Retrieval in Korean and Japanese. , 2005 .

[18]  Yuen-Hsien Tseng,et al.  Automatic thesaurus generation for Chinese documents , 2002, J. Assoc. Inf. Sci. Technol..

[19]  Stephen Tomlinson.  CJK Experiments with Hummingbird SearchServerTM at NTCIR-4 , 2004, NTCIR.

[20]  Hsinchun Chen,et al.  Experiments on Chinese-English Cross-language Retrieval at NTCIR-4 , 2004, NTCIR.

[21]  Yuen-Hsien Tseng,et al.  Comparison of Global Term Expansion Methods for Text Retrieval , 2005, NTCIR.

[22]  Jinxi Xu,et al.  Evaluating a probabilistic model for cross-lingual information retrieval , 2001, SIGIR '01.

[23]  Jiangping Chen.  Toward a unified retrieval outcome analysis framework for cross-language information retrieval , 2005, ASIST.

[24]  John D. Lafferty,et al.  Model-based feedback in the language modeling approach to information retrieval , 2001, CIKM '01.

[25]  Noriko Kando,et al.  Prediction of Performance on Cross-Lingual Information Retrieval by Regression Models , 2004, NTCIR.

[26]  Hsin-Hsi Chen,et al.  The Chinese Text Retrieval Tasks of NTCIR Workshop 2 , 2001, NTCIR.

[27]  Hideo Itoh,et al.  Ricoh in the NTCIR-4 CLIR Tasks , 2004 .

[28]  Fredric C. Gey.  Chinese and Korean Topic Search of Japanese News Collections , 2004, NTCIR.

[29]  Isabelle Moulinier,et al.  Thomson Legal and Regulatory at NTCIR-4: Monolingual and Pivot-Language Retrieval Experiments , 2004, NTCIR.

[30]  Fei Li,et al.  Chinese Information Retrieval Using Lemur: NTCIR-5 CIR Experiments at UNT , 2005, NTCIR.

[31]  Masaki Murata,et al.  Applying Multiple Characteristics and Techniques to Obtain High Levels of Performance in Information Retrieval at NTCIR-4 , 2002, NTCIR.

[32]  Isabelle Moulinier,et al.  Thomson Legal and Regulatory at NTCIR-5: Japanese and Korean Experiments , 2005, NTCIR.

[33]  Tatsunori Mori,et al.  Integration of PLSA into Probabilistic CLIR Model - Yokohama National University at NTCIR4 CLIR , 2004, NTCIR.

[34]  Yufang Sun,et al.  Applying Language Model into IR Task , 2004, NTCIR.

[35]  Stephen Tomlinson,et al.  Experiments with Decompounded Chinese, Japanese and Korean Words Parsed by Hummingbird SearchServerTM at NTCIR-4 , 2004 .

[36]  Kam-Fai Wong,et al.  Pseudo-Relevance Feedback and Title Re-Ranking for Chinese Information Retrieval , 2004, NTCIR.

[37]  Yuen-Hsien Tseng,et al.  Global and Local Term Expansion for Text Retrieval , 2004, NTCIR.

[38]  Gregory Grefenstette,et al.  Justsystem-Clairvoyance CLIR Experiments at NTCIR-4 Workshop , 2004, NTCIR.

[39]  Sumio Fujita.  Revisiting Document Length Hypotheses: NTCIR-4 CLIR and Patent Experiments at Patolis , 2004, NTCIR.

[40]  José Carlos González Cristóbal,et al.  MIRACLE Retrieval Experiments with East Asian Languages , 2005 .

[41]  Kam-Fai Wong,et al.  Some Experiments with Blind Feedback and Re-ranking for Chinese Information Retrieval , 2005, NTCIR.

[42]  Hsin-Hsi Chen,et al.  Merging Multilingual Information Retrieval Results Based on Prediction of Retrieval Effectiveness , 2004, NTCIR.

[43]  Hae-Chang Rim,et al.  KUNLP System for NTCIR-4 Korean-English Cross-Language Information Retrieval , 2004, NTCIR.

[44]  Gina-Anne Levow.  University of Chicago at NTCIR4 CLIR: Multi-Scale Query Expansion , 2004, NTCIR.

[45]  Dong-Hong Ji,et al.  I2R at NTCIR5 , 2005, NTCIR.

[46]  Noriko Kando,et al.  MIMOR @ NTCIR 5: A Fusion-based Approach to Japanese Information Retrieval , 2005, NTCIR.

[47]  Jong-Hyeok Lee,et al.  POSTECH at NTCIR-4: CJKE Monolingual and Korean-related Cross- Language Retrieval Experiments , 2004 .

[48]  Kazuaki Kishida,et al.  Technical issues of cross-language information retrieval: a review , 2005, Inf. Process. Manag..

[49]  Dong-Hong Ji,et al.  Chinese Information Retrieval Based on Related Term Group , 2005, NTCIR.

[50]  Shunsuke Uemura,et al.  CLIR Using Web Directory at NTCIR-4 , 2004, NTCIR.

[51]  Tetsuji Nakagawa,et al.  NTCIR-5 CLIR Experiments at Oki , 2004, NTCIR.

[52]  Dong-Hong Ji,et al.  Chinese Information Retrieval Based on Terms and Ontology , 2004, NTCIR.

[53]  Tetsuya Ishikawa,et al.  Cross-Language IR at University of Tsukuba: Automatic Transliteration for Japanese, English, and Korean , 2004, NTCIR.

[54]  Sumio Fujita.  A Decade after TREC-4 - NTCIR-5 CLIR-J-J Experiments at Yahoo!Japan , 2005, NTCIR.