Research on theme crawler based on Shark-Search and PageRank algorithm
暂无分享,去创建一个
In the theme crawler, the Shark-Search algorithm is insufficient to consider the global Web page. In this paper, the PageRank algorithm is used to calculate the URL's authority to make up for this shortcoming, and Shark-PageRank algorithm, which adopts the anchor text, the context near the anchor text and authoritative value of Web page to measure the value of the URL, is proposed in this paper. The experiment results show that the new algorithm improves the speed and accuracy of the query, and the algorithm has good stability and scalability.
[1] Jay Prakash,et al. Web Crawling through Shark-Search using PageRank , 2015 .
[2] Yoelle Maarek,et al. The Shark-Search Algorithm. An Application: Tailored Web Site Mapping , 1998, Comput. Networks.
[3] Lei Luo,et al. A Novel Shark-Search Algorithm for Theme Crawler , 2012, WISM.
[4] Rajeev Motwani,et al. The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.