This thesis proposes several methods for bilingual corpus form different websites, such as Automatic acquisition of bilingual corpus base on "iciba" web, CNKI and Patent network. It introduced methods, procedures of the acquisition of a variety of corpus. We proposed different methods to obtain the bilingual corpus for different characteristics of different sites, and achieved fast and accurate automatic access of a large-scale bilingual corpus. When we obtain the bilingual corpus based on "iciba" web, the main method is Nutch crawler, which is relatively good, and has an accurate retrieve and a good correlation. In addition, we give up the idea of bilingual corpus obtained from the entire Internet, but we use an entirely new access, that is to access to the basic information of scholarly thesis’s in the CNKI to obtain the large-scale high-quality English-Chinese bilingual corpus. We obtain GB level of large-scale bilingual aligned corpus in the end, which is very accurate by the manual evaluation. And the corpus makes preparation for the further cross-language information retrieval research.
[1]
Hai Zhao,et al.
Exploiting Unlabeled Text with Different Unsupervised Segmentation Criteria for Chinese Word Segmentation
,
2008
.
[2]
Christopher D. Manning,et al.
Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling
,
2005,
ACL.
[3]
Jyh-Shing Roger Jang,et al.
Alignment of bilingual named entities in parallel corpora using statistical models and multiple knowledge sources
,
2006,
TALIP.
[4]
Yu-Chun Wang,et al.
Web-based pattern learning for named entity translation in Korean-Chinese cross-language information retrieval
,
2009,
Expert Syst. Appl..