论文信息 - Data pre-processing on web server logs for generalized association rules mining algorithm

Data pre-processing on web server logs for generalized association rules mining algorithm

Web log file analysis began as a way for IT administrators to ensure adequate bandwidth and server capacity on their organizations website. Log file data can offer valuable insight into web site usage.It reflects actual usage in natural working condition, compared to the artificial setting of a usability lab.It represents the activity of many users, over potentially long period of time, compared to a limited number of users for an hour or two each.This paper describes the pre-processing techniques on IIS Web Server Logs ranging from the raw log file until before mining process can be performed. Since the pre-processing is tedious process, it depending on the algorithm and purposes of the applications.

Mohd Norzali Haji Mohd | Mohd Helmy Abd Wahab | Hafizul Fahri Hanafi | Mohamad Farhan Mohamad Mohsin

[1] Donna L. Hoffman,et al. New metrics for new media: toward the development of Web measurement standards , 1997, World Wide Web J..

[2] Susan Haigh,et al. Measuring Web Site Usage: Log File Analysis , 1998 .

[3] Pramudiono Iko. Parallel platform for large scale Web usage mining , 2004 .

[4] M. Carl Drott. Using Web server logs to improve site design , 1998, SIGDOC '98.

[5] Brian D. Davison. Web Traffic Logs: An Imperfect Resource for Evaluation , 1999 .

[6] Victor Ciesielski,et al. Data Mining of Web Access Logs From an Academic Web Site , 2003, HIS.

[7] Shichao Zhang,et al. Identifying interesting visitors through Web log classification , 2005, IEEE Intelligent Systems.

[8] Chien-Chung Chan,et al. Active User-Based and Ontology-Based Web Log Data Preprocessing for Web Usage Mining , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).