Intensional associations between data and metadata

There is a growing need to associate a variety of metadata with the underlying data, but a simple, elegant approach to uniformly model and query both the data and the metadata has been elusive. In this paper, we argue that (1) the relational model augmented with queries as data values is a natural way to uniformly model data, arbitrary metadata and their associations, and (2) relational queries with a join mechanism augmented to permit matching of query result relations, instead of only atomic values, is an elegant way to uniformly query across data and metadata. We describe the architecture of a system we have prototyped for this purpose, demonstrate the generality of our approach and evaluate the performance of the system, in comparison with previous proposals for metadata management.

[1]  Michael Stonebraker,et al.  Extending a database system with procedures , 1987, TODS.

[2]  Matthias Jarke,et al.  Telos: representing knowledge about information systems , 1990, TOIS.

[3]  Stuart E. Madnick,et al.  A Metadata Approach to Resolving Semantic Conflicts , 2011, VLDB.

[4]  Richard Y. Wang,et al.  Toward quality data: An attribute-based approach , 2014, Decis. Support Syst..

[5]  Maria-Esther Vidal,et al.  Querying Quality of Data Metadata , 1998 .

[6]  Philip A. Bernstein.  Repositories and object oriented databases , 1998, SGMD.

[7]  Jennifer Widom,et al.  Representing and querying changes in semistructured data , 1998, Proceedings 14th International Conference on Data Engineering.

[8]  Gottfried Vossen,et al.  Typed query languages for databases containing queries , 1998, Inf. Syst..

[9]  Elke A. Rundensteiner,et al.  Evolvable view environment (EVE): non-equivalent view maintenance under schema changes , 1999, SIGMOD '99.

[10]  Lois M. L. Delcambre,et al.  Superimposed Information for the Internet , 1999, WebDB.

[11]  Lois M. L. Delcambre,et al.  Models for Superimposed Information , 1999, ER.

[12]  V. Notkola,et al.  Quality of Data , 2000 .

[13]  Elisa Bertino,et al.  On specifying security policies for web documents with an XML-based language , 2001, SACMAT '01.

[14]  Laks V. S. Lakshmanan,et al.  SchemaSQL: An extension to SQL for multidatabase interoperability , 2001, ACM Trans. Database Syst..

[15]  Sanjeev Khanna,et al.  Edinburgh Research Explorer On the Propagation of Deletions and Annotations through Views , 2013 .

[16]  Renée J. Miller,et al.  Mapping Adaptation under Evolving Schemas , 2003, VLDB.

[17]  Theodore Johnson,et al.  Exploratory Data Mining and Data Cleaning , 2003 .

[18]  Goetz Graefe,et al.  PIVOT and UNPIVOT: Optimization and Execution Strategies in an RDBMS , 2004, VLDB.

[19]  Dieter Gawlick,et al.  Applications for expression data in relational database systems , 2004, Proceedings. 20th International Conference on Data Engineering.

[20]  Gottfried Vossen,et al.  Meta-SQL: Towards Practical Meta-Querying , 2004, EDBT.

[21]  Matthias Jarke,et al.  ConceptBase — A deductive object base for meta data management , 1995, Journal of Intelligent Information Systems.

[22]  John Mylopoulos,et al.  Refining Semantic Mappings from Relational Tables to Ontologies , 2004, SWDB.

[23]  Jennifer Widom,et al.  The TSIMMIS Approach to Mediation: Data Models and Languages , 1997, Journal of Intelligent Information Systems.

[24]  Gottfried Vossen,et al.  Towards practical meta-querying , 2002, Inf. Syst..

[25]  James Frew,et al.  Lineage retrieval for scientific data processing: a survey , 2005, CSUR.

[26]  Wang Chiew Tan,et al.  An annotation management system for relational databases , 2004, The VLDB Journal.

[27]  Jennifer Widom,et al.  Trio: A System for Integrated Management of Data, Accuracy, and Lineage , 2004, CIDR.

[28]  John Mylopoulos,et al.  Representing and querying data transformations , 2005, 21st International Conference on Data Engineering (ICDE'05).

[29]  Edward L. Robertson,et al.  Relational languages for metadata integration , 2005, TODS.

[30]  Floris Geerts,et al.  MONDRIAN: Annotating and Querying Databases through Colors and Blocks , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[31]  Divesh Srivastava,et al.  MMS: Using Queries As Data Values for Metadata Management , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[32]  Jeff Z. Pan,et al.  Resource Description Framework , 2020, Definitions.