Data Integration Using Web Services

In this paper we examine the opportunities for data integration in the context of the emerging Web Services systems development paradigm. The paper introduces the programming standards associated with Web Services and provides an example of how Web Services can be used to unlock heterogeneous business systems to extract and integrate business data. We provide an introduction to the problems and research issues encountered when applying Web Services to data integration. We provide a formal definition of aggregation (as a type of data integration) and discuss the impact of Web Services on aggregation. We show that Web Services will make the development of systems for aggregation both faster and less expensive to develop. A system architecture for Web Services based aggregation is presented that is representative of products available from software vendors today. Finally, we highlight some of the challenges facing Web Services that are not currently being addressed by standards bodies or software vendors. These include context mediation, trusted intermediaries, quality and source selection, licensing and payment mechanisms, and systems development tools. We suggest some research directions for each of these challenges.

[1]  Patrick Valduriez,et al.  Scaling Access to Heterogeneous Databases with DISCO , 1998 .

[2]  Stéphane Bressan,et al.  An Active Conceptual Model for Fixed Income Securities Analysis for Multiple Financial Institutions , 1998, ER.

[3]  Stuart E. Madnick,et al.  Working Paper Alfred P. Sloan School of Management Database Systems in a Dynamic Environment Database Systems in a Dynamic Environment Received Context Interchange: Overcoming the Challenges of Large-scale Interoperable Database Systems in a Dynamic Environment* , 2022 .

[4]  Stuart E. Madnick,et al.  Meta-Data Jones and the Tower of Babel: The Challenge of Large-Scale Semantic Heterogeneity , 1999, MD.

[5]  Stuart E. Madnick,et al.  Surviving and Thriving in the New World of Web Aggregators , 2000 .

[6]  Stuart E. Madnick,et al.  Improving the Quality of Corporate Household Data: Current Practices and Research Directions , 2001, IQ.

[7]  Benjamin N. Grosof.  Standardizing XML Rules: Preliminary Outline of Invited Talk , 2001 .

[8]  Stuart E. Madnick,et al.  Representing and reasoning about semantic conflicts in heterogeneous information systems , 1997 .

[9]  Setsuo Ohsuga,et al.  INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES , 1977 .

[10]  Stuart E. Madnick,et al.  Context interchange: sharing the meaning of data , 1991, SGMD.

[11]  Stéphane Bressan,et al.  Context Interchange: New Features and Formalisms for the Intelligent Integration of Information Context Interchange: New Features and Formalisms for the Intelligent Integration of Information , 1997 .

[12]  Stéphane Bressan,et al.  Context Knowledge Representation and Reasoning in the Context Interchange System , 2015, Applied Intelligence.

[13]  Stuart E. Madnick,et al.  The Misguided Silver Bullet: What XML will and will NOT do to help Information Integration , 2001 .

[14]  Benjamin N. Grosof,et al.  An Approach to Using XML and a Rule-Based Content Language with an Agent Communication Language , 2000, Issues in Agent Communication.

[15]  Stuart E. Madnick,et al.  Corporate Household Data: Research Directions , 2001 .

[16]  Stuart E. Madnick,et al.  A Metadata Approach to Resolving Semantic Conflicts , 2011, VLDB.

[17]  Richard D. Hackathorn,et al.  Web Farming for the Data Warehouse , 1998 .

[18]  Patrick Valduriez,et al.  Scaling Access to Heterogeneous Data Sources with DISCO , 1998, IEEE Trans. Knowl. Data Eng..