MemBeR: A Micro-benchmark Repository for XQuery

XQuery is a feature-rich language with complex semantics. This makes it hard to come up with a benchmark suite which covers all performance-critical features of the language, and at the same time allows one to individually validate XQuery evaluation techniques. This paper presents MemBeR, a micro-benchmark repository, allowing the evaluation of an XQuery implementation with respect to precise evaluation techniques. We take the view that a fixed set of queries is probably insufficient to allow testing for various performance aspects, thus, the users of the repository must be able to add new data sets and/or queries for specific performance assessment tasks. We present our methodology for constructing the micro-benchmark repository, and illustrate with some sample micro-benchmarks.

[1]  Kyuseok Shim,et al.  XTRACT: Learning Document Type Descriptors from XML Document Collections , 2004, Data Mining and Knowledge Discovery.

[2]  Dan Suciu,et al.  Containment and equivalence for a fragment of XPath , 2004, JACM.

[3]  Georg Gottlob,et al.  The complexity of XPath query evaluation , 2003, PODS.

[4]  Patrick E. O'Neil,et al.  ORDPATHs: insert-friendly XML node labels , 2004, SIGMOD '04.

[5]  Roy Goldman,et al.  DataGuides: Enabling Query Formulation and Optimization in Semistructured Databases , 1997, VLDB.

[6]  Jennifer Widom,et al.  Query Optimization for Semistructured Data , 1997 .

[7]  Jennifer Widom,et al.  Indexing Semistructured Data , 1998 .

[8]  Cong Yu,et al.  TIMBER: A native XML database , 2002, The VLDB Journal.

[9]  S. Boag,et al.  XQuery 1.0 : An XML query language, W3C Working Draft 12 November 2003 , 2003 .

[10]  Erhard Rahm,et al.  XMach-1: A Benchmark for XML Data Management , 2001, BTW.

[11]  Massimo Franceschet.  XPathMark: An XPath Benchmark for the XMark Generated Data , 2005, XSym.

[12]  M. Tamer Özsu,et al.  XBench benchmark and performance testing of XML DBMSs , 2004, Proceedings. 20th International Conference on Data Engineering.

[13]  Denilson Barbosa,et al.  The XML web: a first study , 2003, WWW '03.

[14]  Steven J. DeRose,et al.  XML Path Language (XPath) Version 1.0 , 1999 .

[15]  Dan Suciu,et al.  Containment and equivalence for an XPath fragment , 2002, PODS.

[16]  Giuseppe Castagna,et al.  A Full Pattern-Based Paradigm for XML Query Processing , 2005, PADL.

[17]  Stéphane Bressan,et al.  XOO7: applying OO7 benchmark to XML query processing tool , 2001, CIKM '01.

[18]  Ioana Manolescu,et al.  Why and how to benchmark XML databases , 2001, SGMD.

[19]  Denilson Barbosa,et al.  ToXgene: a template-based data generator for XML , 2002, SIGMOD '02.

[20]  Jan Hidders,et al.  A Light but Formal Introduction to XQuery , 2004, XSym.

[21]  Laks V. S. Lakshmanan,et al.  Tree logical classes for efficient evaluation of XQuery , 2004, SIGMOD '04.

[22]  Denilson Barbosa,et al.  ToXgene: An extensible template-based data generator for XML , 2002, WebDB.

[23]  Jignesh M. Patel,et al.  The Michigan benchmark: towards XML query performance diagnostics , 2006, Inf. Syst..