论文信息 - Traitor: Associating Concepts using the World Wide Web

Traitor: Associating Concepts using the World Wide Web

We use Common Crawl's 25TB data set of web pages to construct a database of associated concepts using Hadoop. The database can be queried through a web application with two query interfaces. A textual interface allows searching for similarities and differences between multiple concepts using a query language similar to set notation, and a graphical interface allows users to visualize similarity relationships of concepts in a force directed graph.

Djoerd Hiemstra | Lesley Wevers | Oliver Jundt | Wanno Drijfhout

[1] Kenneth Ward Church,et al. Word Association Norms, Mutual Information, and Lexicography , 1989, ACL.

[2] Alistair Moffat,et al. A similarity measure for indefinite rankings , 2010, TOIS.

[3] Mitsuru Ishizuka,et al. Keyword extraction from a single document using word co-occurrence statistical information , 2004, Int. J. Artif. Intell. Tools.

[4] Curt Burgess,et al. Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[6] Christina Lioma,et al. Rhetorical relations for information retrieval , 2012, SIGIR '12.

[7] Fumihiro Matsuo,et al. A Method of Extracting Related Words Using Standardized Mutual Information , 2003, Discovery Science.

[8] Qinghua Zheng,et al. Mining query subtopics from search log data , 2012, SIGIR '12.