Universal Scanning and Sequential Decision Making for Multidimensional Data

We investigate the problem of scanning and prediction (\scandiction", for short) of multidimensional data arrays. This problem arises in several aspects of image and video processing, such as predictive coding, for example, where an image is compressed by coding the error sequence resulting from scandicting it. Thus, it is natural to ask what is the optimal method to scan and predict a given image, what is the resulting minimum prediction loss, and whether there exist speciflc scandiction schemes which are universal in some sense. Speciflcally, we investigate the following problems: First, modeling the data array as a random fleld, we wish to examine whether there exists a scandiction scheme which is independent of the fleld’s distribution, yet asymptotically achieves the same performance as if this distribution was known. This question is answered in the a‐rmative for the set of all spatially stationary random flelds and under mild conditions on the loss function. We then discuss the scenario where a non-optimal scanning order is used, yet accompanied by an optimal predictor, and derive bounds on the excess loss compared to optimal scanning and prediction. This paper is the flrst part of a two-part paper on sequential decision making for multidimensional data. It deals with clean, noiseless data arrays. The second part [1] deals with

[1]  Guillermo Sapiro,et al.  LOCO-I: a low complexity, context-based, lossless image compression algorithm , 1996, Proceedings of Data Compression Conference - DCC '96.

[2]  Desh Ranjan,et al.  Space-Filling Curves and Their Use in the Design of Geometric Data Structures , 1997, Theor. Comput. Sci..

[3]  David Haussler,et al.  Sequential Prediction of Individual Sequences Under General Loss Functions , 1998, IEEE Trans. Inf. Theory.

[4]  Daniel Cohen-Or,et al.  Context‐based Space Filling Curves , 2000, Comput. Graph. Forum.

[5]  Claude-Henri Lamarque,et al.  Image analysis using space-filling curves and 1D wavelet bases , 1996, Pattern Recognit..

[6]  Jacob Ziv,et al.  On universal quantization , 1985, IEEE Trans. Inf. Theory.

[7]  Toby Berger,et al.  Information measures for discrete random fields , 1998 .

[8]  Craig Gotsman,et al.  Universal Rendering Sequences for Transparent Vertex Caching of Progressive Meshes , 2002, Comput. Graph. Forum.

[9]  Tsachy Weissman,et al.  Scanning and Sequential Decision Making for Multidimensional Data—Part II: The Noisy Case , 2008, IEEE Transactions on Information Theory.

[10]  Tamás Linder,et al.  A zero-delay sequential scheme for lossy coding of individual sequences , 2001, IEEE Trans. Inf. Theory.

[11]  Nasir D. Memon,et al.  An analysis of some common scanning techniques for lossless image coding , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[12]  Neri Merhav,et al.  Universal Prediction , 1998, IEEE Trans. Inf. Theory.

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Neri Merhav,et al.  Universal prediction of individual sequences , 1992, IEEE Trans. Inf. Theory.

[15]  Abraham Lempel,et al.  Compression of two-dimensional data , 1986, IEEE Trans. Inf. Theory.

[16]  Amir Dembo,et al.  Source coding, large deviations, and approximate pattern matching , 2001, IEEE Trans. Inf. Theory.

[17]  H. Sagan Space-filling curves , 1994 .

[18]  László Györfi,et al.  A simple randomized algorithm for sequential prediction of ergodic time series , 1999, IEEE Trans. Inf. Theory.

[19]  Tsachy Weissman,et al.  Universal prediction of individual binary sequences in the presence of noise , 2001, IEEE Trans. Inf. Theory.

[20]  R. Gray,et al.  Asymptotically Mean Stationary Measures , 1980 .

[21]  Tsachy Weissman,et al.  Universal prediction of random binary sequences in a noisy environment , 2004 .

[22]  Tsachy Weissman,et al.  On limited-delay lossy coding and filtering of individual sequences , 2002, IEEE Trans. Inf. Theory.

[23]  Christos Faloutsos,et al.  Analysis of the Clustering Properties of the Hilbert Space-Filling Curve , 2001, IEEE Trans. Knowl. Data Eng..

[24]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[25]  Tsachy Weissman,et al.  Scanning and prediction in multidimensional data arrays , 2002, IEEE Trans. Inf. Theory.

[26]  Ewa Skubalska-Rafajlowicz,et al.  Pattern recognition algorithms based on space-filling curves and orthogonal expansions , 2001, IEEE Trans. Inf. Theory.

[27]  Tamás Linder,et al.  Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding , 2004, IEEE Transactions on Signal Processing.

[28]  Ioannis Kontoyiannis,et al.  Pattern matching and lossy data compression on random fields , 2003, IEEE Trans. Inf. Theory.

[29]  Vladimir Vovk,et al.  Aggregating strategies , 1990, COLT '90.

[30]  Nasir D. Memon,et al.  Lossless Image Compression with a Codebook of Block Scans , 1995, IEEE J. Sel. Areas Commun..

[31]  Neri Merhav,et al.  On sequential strategies for loss functions with memory , 2002, IEEE Trans. Inf. Theory.