The World Wide Web has become a vast resource of information. The problem is that finding the information that an individual desires is often quite difficult, because of the complexity in organization and the quantity of information stored. Information is stored in uniquely named files located within uniquely named directories on a Website identified by a series of four numbers or a corresponding symbolic name. The number of directories and files is limited only by storage capacity and content availability. Finding the right page, the one containing the information that is sought in one of those uniquely named files, via its Uniform Resource Locator (URL; protocol + host + file -e.g., http://acm.uta. edu/youngblood/index.html) would be nearly impossible if an individual had to guess where the information was located. Fortunately, search engines such as Alta Vista (www.altavista.com), Yahoo (www.yahoo.com), HotBot (www.hotbot.com), and many others have made navigating the Web easier. These services provide users access to large databases containing keyword cross references to URLs. The heart of a search engine is the search agent, which collects the information to be placed in the database.
[1]
M. Koster.
The web robots pages
,
1999
.
[2]
Herbert Schildt,et al.
C, the complete reference
,
1987
.
[3]
Guido Rossum,et al.
Internet Programming With Python
,
1996
.
[4]
Ronald L. Rivest,et al.
Introduction to Algorithms
,
1990
.
[5]
Roy T. Fielding,et al.
Hypertext Transfer Protocol - HTTP/1.1
,
1997,
RFC.
[6]
Peter Norvig,et al.
Artificial Intelligence: A Modern Approach
,
1995
.
[7]
Roy T. Fielding,et al.
Hypertext Transfer Protocol - HTTP/1.0
,
1996,
RFC.
[8]
Leslie S. Foster,et al.
C By Discovery
,
2000
.
[9]
Andrew S. Tanenbaum,et al.
Computer networks (3rd ed.)
,
1996
.
[10]
Arnold Robbins,et al.
Linux in a Nutshell
,
1997
.
[11]
Jack Dongarra,et al.
MPI: The Complete Reference
,
1996
.