论文信息 - Automatic Data Extraction from Web Discussion Forums

Automatic Data Extraction from Web Discussion Forums

This paper presents an approach to extract information from web discussion forums automatically. HTML tag paths built from a HTML DOM tree are employed to generate the post extraction template. Visual text features and HTML structure information in the same page are also combined together to extract author profile, posted date and post content automatically. Experiment results show that our approach is effective.

[1] Tobias Dönz. Extracting Structured Data from Web Pages , 2003 .

[2] Wuu Yang,et al. Identifying syntactic differences between two programs , 1991, Softw. Pract. Exp..

[3] Bing Liu,et al. Web data extraction based on partial tree alignment , 2005, WWW '05.

[4] Calton Pu,et al. A fully automated object extraction system for the World Wide Web , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[5] Robert L. Grossman,et al. Mining data records in Web pages , 2003, KDD '03.

[6] Qi He,et al. An information extraction engine for web discussion forums , 2005, WWW '05.

[7] Vijay V. Raghavan,et al. Fully automatic wrapper generation for search engines , 2005, WWW '05.

[8] Jun'ichi Tsujii,et al. Bidirectional Inference with the Easiest-First Strategy for Tagging Sequence Data , 2005, HLT.

[9] Chia-Hui Chang,et al. IEPAD: information extraction based on pattern discovery , 2001, WWW '01.

[10] Frederick H. Lochovsky,et al. Data extraction and label assignment for web databases , 2003, WWW '03.

[11] Valter Crescenzi,et al. RoadRunner: Towards Automatic Data Extraction from Large Web Sites , 2001, VLDB.