A middleware approach for combining heterogeneous data sources - integration of generic query and predefined function access

With the emergence of so-called application systems which encapsulate databases and their applications, pure data integration using, for example, a federated database system is not possible anymore. Instead, access via predefined functions is the only way to get data from an application system. As a result, the combination of generic query as well as predefined function access is needed in order to integrate heterogeneous data sources. The authors focus on a middleware approach supporting this novel and extended kind of integration. Starting with the overall architecture, we explain the functionality and cooperation of its core components: a federated database system (FDBS) and a workflow management system (WfMS). Afterwards, we concentrate on the key problems of function integration by discussing query execution planning, precedence control of function execution, and parameter handling. In this context, we develop a lightweight description language based on XML for the global-to-local mapping of functions. In addition, we consider some important aspects of the execution model, focusing on the interaction of the FDBS and the WfMS as well as the support of distributed transactions.

[1]  Theo Härder,et al.  The intrinsic problems of structural heterogeneity and an approach to their solution , 1999, The VLDB Journal.

[2]  Umeshwar Dayal,et al.  Query Processing in a Multidatabase System , 1985, Query Processing in Database Systems.

[3]  Roger Price,et al.  Final Committee Draft , 1999 .

[4]  Klaus R. Dittrich,et al.  An Object-Oriented Integration Framework for Building Heterogeneous Database Systems , 1992, DS-5.

[5]  R. Gagliardi,et al.  An operational approach to the integration of distributed heterogeneous environments , 1990, Proceedings. PARBASE-90: International Conference on Databases, Parallel Architectures, and Their Applications.

[6]  Mary Roth,et al.  Don't Scrap It, Wrap It! A Wrapper Architecture for Legacy Data Sources , 1997, VLDB.

[7]  Elisa Bertino,et al.  An overview of the Comandos Integration System , 1995 .

[8]  Frank Leymann,et al.  Supporting Business Transactions Via Partial Backward Recovery In Workflow Management Systems , 1995, BTW.

[9]  David Orchard,et al.  XML Linking Language (XLink) , 2001 .

[10]  C. M. Sperberg-McQueen,et al.  Extensible Markup Language (XML) , 1997, World Wide Web J..

[11]  David W. Embley,et al.  An approach to schema integration and query formulation in federated database systems , 1987, 1987 IEEE Third International Conference on Data Engineering.

[12]  Stefano Ceri,et al.  Towards Megaprogramming , 1990 .

[13]  Stefano Ceri,et al.  Toward megaprogramming , 1992, CACM.

[14]  Andreas Reuter,et al.  Principles of transaction-oriented database recovery , 1983, CSUR.

[15]  Frank Leymann,et al.  Production Workflow: Concepts and Techniques , 1999 .

[16]  Klaudia Hergula,et al.  The Heterogeneity Problem and Middleware Technology: Experiences with and Performance of Database Gateways , 1998, VLDB.

[17]  C. M. Sperberg-McQueen,et al.  eXtensible Markup Language (XML) 1.0 (Second Edition) , 2000 .