Web search engine based on DNS

Now no web search engine can cover more than 60% of all the pages on Internet. The update interval of most pages database is almost one month. This condition has not changed for many years. Coverage and update problems have become the bottleneck problem of current web search engine. To solve these problems, a new system, search engine based on DNS is proposed in this paper. This system adopts the layered distributed architecture like DNS, which is different from any current commercial search engine. In theory, this system can cover all the web pages on Internet. Its update interval could even be one day. The original idea, detailed content and implementation of this system all are introduced in this paper.

[1]  Peter B. Danzig,et al.  The Harvest Information Discovery and Access System , 1995, Comput. Networks ISDN Syst..

[2]  Wang Jun.  Open Archives Initiative Protocol for Metadata Harvesting , 2005 .

[3]  Liang Sun,et al.  Implementation of large-scale distributed information retrieval system , 2001, 2001 International Conferences on Info-Tech and Info-Net. Proceedings (Cat. No.01EX479).

[4]  Jon M. Kleinberg,et al.  Mining the Web's Link Structure , 1999, Computer.

[5]  Mark A. C. J. Overmeer.  My personal search engine , 1999, Comput. Networks.

[6]  James Mayfield,et al.  Searching the World-Wide Web Using Signature Files , 1995 .

[7]  Ronald Fagin,et al.  Searching the workplace web , 2003, WWW '03.

[8]  Knut Magne Risvik,et al.  Search engines and Web dynamics , 2002, Comput. Networks.

[9]  Minoru Uehara,et al.  Searching restricted documents in a cooperative search engine , 2004, 24th International Conference on Distributed Computing Systems Workshops, 2004. Proceedings..

[10]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[11]  Erich J. Neuhold,et al.  ADMIRE: an adaptive data model for meta search engines , 2000, Comput. Networks.

[12]  Monika Henzinger,et al.  Hyperlink Analysis for the Web , 2001, IEEE Internet Comput..

[13]  Fei Xie,et al.  Web search with personalization and knowledge , 2002, Fourth International Symposium on Multimedia Software Engineering, 2002. Proceedings..

[14]  Carl Lagoze,et al.  The Open Archives Initiative Protocol for Metadata Harvesting Protocol , 2002 .

[15]  Dik Lun Lee,et al.  A World Wide Web Resource Discovery System , 1995, World Wide Web J..

[16]  Baowen Xu,et al.  Development of a self-adaptive Web search engine , 2001, Proceedings 3rd International Workshop on Web Site Evolution. WSE 2001.

[17]  Minoru Uehara,et al.  A distributed search engine for fresh information retrieval , 2001, 12th International Workshop on Database and Expert Systems Applications.