System and method for identifying web crawler

The invention relates to a system and method for identifying a web crawler. The system is characterized by comprising a buffering module, a training module, an identifying module, an identifying crawler and a forwarding module, wherein the buffering module is used for storing a request entering the system; when the system starts running, the request is transmitted to the training module; and after training time is over, the request is transmitted to the identifying module; the training module is used for training the request and learning a correspond request for performing suspicion degree calculation; the identifying module is used for analyzing a request submitted to the identifying module, identifying the crawler, recording a source address of the crawler, filtering according to sourceaddress, and discarding data from the crawler address; and the forwarding module is used for forwarding a request permitted by the training module and the identifying module.