Service Crawling in Cloud Computing

The cloud service user of a single service relies on specific service capabilities to query relevant data. It can be difficult to consistently query since data is distributed across multiple services. In this paper, we are going to develop an algorithm to crawl the services within a cloud service inventory invoking fetch capabilities and following Internet protocol addresses among the resources assembling retrieved data in a centralized query enabled indexing service. Crawling techniques are being used for pre-cache information [1] that a user needs for post processing information at current available resource(s) for improving user latency to safe requests.

[1]  Pawan Kumar,et al.  Notice of Violation of IEEE Publication Principles The Anatomy of a Large-Scale Hyper Textual Web Search Engine , 2009 .

[2]  Rafael Alonso,et al.  Data caching issues in an information retrieval system , 1990, TODS.

[3]  Jianguo Lu,et al.  An Approach to Deep Web Crawling by Sampling , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[4]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[5]  Kai-Hsiang Yang,et al.  Approximate search engine optimization for directory service , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[6]  Pooja Gupta,et al.  Implementation of Web Crawler , 2009, 2009 Second International Conference on Emerging Trends in Engineering & Technology.