Method and device for automatically identifying web crawlers

The invention discloses a method and a device for automatically identifying web crawlers. The device comprises an acquisition unit, a judgment unit and an identification unit, wherein the acquisition unit is used for acquiring web requests from a remote host to a Web server in certain time; the judgment unit is used for judging whether the time interval of the adjacent web requests is greater than or equal to a predetermined threshold value delta of the time interval of the adjacent web requests; and the identification unit is used for judging whether the operation of the remote host is the web crawler according to whether each judgment result meets the preset condition. The method and the device can quickly detect the web crawlers of various types so as to provide precious response time for subsequent security response.