Web spider identification method
暂无分享,去创建一个
The invention provides a web spider identification method. The web spider identification method comprises the following steps that links which are located on an entry page and can guide a following page is determined, novel invalid links are established in the determined links, the established invalid links are set to be hidden, and a request is identified to be a web spider request when the request is sent to access the hidden invalid links. The web spider identification method has the advantages that the fact whether a request is sent by a web spider can be judged accurately and the identification effect can be obviously improved along with the accumulation of the using time.