Novel Results on the Number of Runs of the Burrows-Wheeler-Transform

The Burrows-Wheeler-Transform (BWT), a reversible string transformation, is one of the fundamental components of many current data structures in string processing. It is central in data compression, as well as in efficient query algorithms for sequence data, such as webpages, genomic and other biological sequences, or indeed any textual data. The BWT lends itself well to compression because its number of equal-letter-runs (usually referred to as $r$) is often considerably lower than that of the original string; in particular, it is well suited for strings with many repeated factors. In fact, much attention has been paid to the $r$ parameter as measure of repetitiveness, especially to evaluate the performance in terms of both space and time of compressed indexing data structures. In this paper, we investigate $\rho(v)$, the ratio of $r$ and of the number of runs of the BWT of the reverse of $v$. Kempa and Kociumaka [FOCS 2020] gave the first non-trivial upper bound as $\rho(v) = O(\log^2(n))$, for any string $v$ of length $n$. However, nothing is known about the tightness of this upper bound. We present infinite families of binary strings for which $\rho(v) = \Theta(\log n)$ holds, thus giving the first non-trivial lower bound on $\rho(n)$, the maximum over all strings of length $n$. Our results suggest that $r$ is not an ideal measure of the repetitiveness of the string, since the number of repeated factors is invariant between the string and its reverse. We believe that there is a more intricate relationship between the number of runs of the BWT and the string's combinatorial properties.

[1]  M. Lothaire,et al.  Algebraic Combinatorics on Words: Index of Notation , 2002 .

[2]  Aldo de Luca,et al.  Sturmian Words: Structure, Combinatorics, and Their Arithmetics , 1997, Theor. Comput. Sci..

[3]  Antonio Restivo,et al.  Circular sturmian words and Hopcroft's algorithm , 2009, Theor. Comput. Sci..

[4]  Grzegorz Rozenberg,et al.  Structures in Logic and Computer Science, A Selection of Essays in Honor of Andrzej Ehrenfeucht , 1997 .

[5]  Dominik Kempa Optimal Construction of Compressed Indexes for Highly Repetitive Texts , 2019, SODA.

[6]  Hideo Bannai,et al.  Online LZ77 Parsing and Matching Statistics with RLBWTs , 2018, CPM.

[7]  En-Hui Yang,et al.  Grammar-based codes: A new class of universal lossless source codes , 2000, IEEE Trans. Inf. Theory.

[8]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[9]  Aldo de Luca,et al.  A Combinatorial Property of the Fibonacci Words , 1981, Inf. Process. Lett..

[10]  David Haussler,et al.  Complete inverted files for efficient text retrieval and analysis , 1987, JACM.

[11]  Antonio Restivo,et al.  Hopcroft's Algorithm and Cyclic Automata , 2008, LATA.

[12]  James A. Storer,et al.  Data compression via textual substitution , 1982, JACM.

[13]  Dominik Kempa,et al.  At the roots of dictionary compression: string attractors , 2017, STOC.

[14]  D. J. Wheeler,et al.  A Block-sorting Lossless Data Compression Algorithm , 1994 .

[15]  Aldo de Luca,et al.  Sturmian Words, Lyndon Words and Trees , 1997, Theor. Comput. Sci..

[16]  M. Lothaire Algebraic Combinatorics on Words , 2002 .

[17]  Antonio Restivo,et al.  Burrows-Wheeler transform and Sturmian words , 2003, Inf. Process. Lett..

[18]  Filippo Mignosi,et al.  Some Combinatorial Properties of Sturmian Words , 1994, Theor. Comput. Sci..

[19]  Donald E. Knuth,et al.  Fast Pattern Matching in Strings , 1977, SIAM J. Comput..

[20]  Mathieu Raffinot,et al.  Composite Repetition-Aware Data Structures , 2015, CPM.

[21]  Hiroshi Sakamoto,et al.  A faster implementation of online RLBWT and its application to LZ77 parsing , 2018, J. Discrete Algorithms.

[22]  Christophe Reutenauer,et al.  On Christoffel classes , 2006, RAIRO Theor. Informatics Appl..

[23]  Guillaume Lagarde,et al.  Lempel-Ziv: a "one-bit catastrophe" but not a tragedy , 2018, SODA.

[24]  Aldo de Luca,et al.  Combinatories of Standard Sturmian Words , 1997, Structures in Logic and Computer Science.

[25]  Alberto Policriti,et al.  From LZ77 to the Run-Length Encoded Burrows-Wheeler Transform, and Back , 2017, CPM.

[26]  Gonzalo Navarro,et al.  Fully Functional Suffix Trees and Optimal Text Searching in BWT-Runs Bounded Space , 2018, J. ACM.

[27]  Tomasz Kociumaka,et al.  Resolution of the Burrows-Wheeler Transform Conjecture , 2019, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[28]  G. Navarro,et al.  Towards a Definitive Measure of Repetitiveness , 2019, LATIN.