A hierarchical model of a FTP search engine with applications

Abstract Because the traditional FTP search engines usually adopt centralised spiders to collect data, insufficient temporal effectiveness is their major demerit. For solving this problem, this paper presents an efficient hierarchical FTP search engine model that deploys the spider agent on the node host of some specific network for collecting file data of FTP servers. The key technologies involve a regional responsibility mechanism, a search mechanism based on the asynchronous retrieval technology and a PAT Tree storage mechanism. The simulation shows that the responding time is less than that of the traditional system and the temporal effectiveness arrives at the application level. In addition, the test results show that the architecture has a good scalability.