WSCE: A Crawler Engine for Large-Scale Discovery of Web Services

This paper addresses issues relating to the efficient access and discovery of Web services across multiple UDDI business registries (UBRs). The ability to explore Web services across multiple UBRs is becoming a challenge particularly as size and magnitude of these registries increase. As Web services proliferate, finding an appropriate Web service across one or more service registries using existing registry APIs (i.e. UDDI APIs) raises a number of concerns such as performance, efficiency, end-to-end reliability, and most importantly quality of returned results. Clients do not have to endlessly search accessible UBRs for finding appropriate Web services particularly when operating via mobile devices. Finding relevant Web services should be time effective and highly productive. In an attempt to enhance the efficiency of searching for businesses and Web services across multiple UBRs, we propose a novel exploration engine, the Web service crawler engine (WSCE). WSCE is capable of crawling multiple UBRs, and enables for the establishment of a centralized Web services' repository which can be used for large-scale discovery of Web services. The paper presents experimental validation, results, and analysis of the presented ideas.

[1]  Erhard Rahm,et al.  A survey of approaches to automatic schema matching , 2001, The VLDB Journal.

[2]  Yiming Yang,et al.  A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[3]  Eyhab Al-Masri,et al.  Crawling multiple UDDI business registries , 2007, WWW '07.

[4]  E. Michael Maximilien,et al.  Conceptual model of web service reputation , 2002, SGMD.

[5]  Eyhab Al-Masri,et al.  A Framework for Efficient Discovery of Web Services Across Heterogeneous Registries , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[6]  Eyhab Al-Masri,et al.  A context-aware mobile service discovery and selection mechanism using artificial neural networks , 2006, ICEC '06.

[7]  Takahiro Kawamura,et al.  Importing the Semantic Web in UDDI , 2002, WES.

[8]  Jun Zhang,et al.  Simlarity Search for Web Services , 2004, VLDB.

[9]  Bu-Sung Lee,et al.  UX- An Architecture Providing QoS-Aware and Federated Support for UDDI , 2003, ICWS.

[10]  Amit P. Sheth,et al.  Discovery of Web services in a federated registry environment , 2004, Proceedings. IEEE International Conference on Web Services, 2004..

[11]  Wolfgang Nejdl,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[12]  Jing Zhong,et al.  A Semantic Web Based Peer-to-Peer Service Registry Network , 2005, 2005 First International Conference on Semantics, Knowledge and Grid.

[13]  Eyhab Al-Masri,et al.  Interoperability among Service Registry Standards , 2007, IEEE Internet Computing.

[14]  Sujata Banerjee,et al.  Scalable Grid Service Discovery based on UDDI , 2005, MGC '05.

[15]  J. Roy,et al.  Understanding Web services , 2001 .

[16]  Takahiro Kawamura,et al.  Semantic Matching of Web Services Capabilities , 2002, SEMWEB.

[17]  Nicholas Kushmerick,et al.  Learning to Attach Semantic Metadata to Web Services , 2003, International Semantic Web Conference.

[18]  Divyakant Agrawal,et al.  A peer-to-peer framework for Web service discovery with ranking , 2004, Proceedings. IEEE International Conference on Web Services, 2004..

[19]  Athman Bouguettaya,et al.  Efficient delivery of web services , 2004 .

[20]  Erhard Rahm,et al.  Similarity flooding: a versatile graph matching algorithm and its application to schema matching , 2002, Proceedings 18th International Conference on Data Engineering.

[21]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .