Scanning and Sequential Decision Making for Multidimensional Data–Part I: The Noiseless Case

We investigate the problem of scanning and prediction (ldquoscandiction,rdquo for short) of multidimensional data arrays. This problem arises in several aspects of image and video processing, such as predictive coding, for example, where an image is compressed by coding the error sequence resulting from scandicting it. Thus, it is natural to ask what is the optimal method to scan and predict a given image, what is the resulting minimum prediction loss, and whether there exist specific scandiction schemes which are universal in some sense. Specifically, we investigate the following problems: first, modeling the data array as a random field, we wish to examine whether there exists a scandiction scheme which is independent of the field's distribution, yet asymptotically achieves the same performance as if this distribution were known. This question is answered in the affirmative for the set of all spatially stationary random fields and under mild conditions on the loss function. We then discuss the scenario where a nonoptimal scanning order is used, yet accompanied by an optimal predictor, and derive bounds on the excess loss compared to optimal scanning and prediction. This paper is the first part of a two-part paper on sequential decision making for multidimensional data. It deals with clean, noiseless data arrays. The second part deals with noisy data arrays, namely, with the case where the decision maker observes only a noisy version of the data, yet it is judged with respect to the original, clean data.

[1]  Vladimir Vovk,et al.  Aggregating strategies , 1990, COLT '90.

[2]  Shie Mannor,et al.  On Universal Compression of Multi-Dimensional Data Arrays Using Self-Similar Curves , 2000 .

[3]  Tsachy Weissman,et al.  Universal Scanning and Sequential Decision Making for Multidimensional Data , 2006, 2006 IEEE International Symposium on Information Theory.

[4]  Tamás Linder,et al.  A zero-delay sequential scheme for lossy coding of individual sequences , 2001, IEEE Trans. Inf. Theory.

[5]  Neri Merhav,et al.  Universal Filtering Via Prediction , 2007, IEEE Transactions on Information Theory.

[6]  Tsachy Weissman,et al.  Universal prediction of individual binary sequences in the presence of noise , 2001, IEEE Trans. Inf. Theory.

[7]  Amir Dembo,et al.  Source coding, large deviations, and approximate pattern matching , 2001, IEEE Trans. Inf. Theory.

[8]  Neri Merhav,et al.  On sequential strategies for loss functions with memory , 2002, IEEE Trans. Inf. Theory.

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  Nasir D. Memon,et al.  Lossless Image Compression with a Codebook of Block Scans , 1995, IEEE J. Sel. Areas Commun..

[11]  Tamás Linder,et al.  Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding , 2004, IEEE Transactions on Signal Processing.

[12]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[13]  T. Haijiang,et al.  Lossless image compression via multi-scanning and adaptive linear prediction , 2004, The 2004 IEEE Asia-Pacific Conference on Circuits and Systems, 2004. Proceedings..

[14]  Tsachy Weissman,et al.  Scanning and prediction in multidimensional data arrays , 2002, IEEE Trans. Inf. Theory.

[15]  Ioannis Kontoyiannis,et al.  Pattern matching and lossy data compression on random fields , 2003, IEEE Trans. Inf. Theory.

[16]  Christos Faloutsos,et al.  Analysis of the Clustering Properties of the Hilbert Space-Filling Curve , 2001, IEEE Trans. Knowl. Data Eng..

[17]  Nasir D. Memon,et al.  An analysis of some common scanning techniques for lossless image coding , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[18]  Guillermo Sapiro,et al.  LOCO-I: a low complexity, context-based, lossless image compression algorithm , 1996, Proceedings of Data Compression Conference - DCC '96.

[19]  Claude-Henri Lamarque,et al.  Image analysis using space-filling curves and 1D wavelet bases , 1996, Pattern Recognit..

[20]  David Haussler,et al.  Sequential Prediction of Individual Sequences Under General Loss Functions , 1998, IEEE Trans. Inf. Theory.

[21]  Ewa Skubalska-Rafajlowicz,et al.  Pattern recognition algorithms based on space-filling curves and orthogonal expansions , 2001, IEEE Trans. Inf. Theory.

[22]  Craig Gotsman,et al.  Universal Rendering Sequences for Transparent Vertex Caching of Progressive Meshes , 2002, Comput. Graph. Forum.

[23]  Daniel Cohen-Or,et al.  Context‐based Space Filling Curves , 2000, Comput. Graph. Forum.

[24]  Rolf Niedermeier,et al.  Towards optimal locality in mesh-indexings , 1997, Discret. Appl. Math..

[25]  Bruce E. Hajek,et al.  Information measures for discrete random fields , 1999, IEEE Trans. Inf. Theory.

[26]  Luiz Velho,et al.  Digital halftoning with space filling curves , 1991, SIGGRAPH.

[27]  Tsachy Weissman,et al.  Universal prediction of random binary sequences in a noisy environment , 2004 .

[28]  R. Gray,et al.  Asymptotically Mean Stationary Measures , 1980 .

[29]  László Györfi,et al.  A simple randomized algorithm for sequential prediction of ergodic time series , 1999, IEEE Trans. Inf. Theory.

[30]  Desh Ranjan,et al.  Space-Filling Curves and Their Use in the Design of Geometric Data Structures , 1997, Theor. Comput. Sci..

[31]  Tsachy Weissman,et al.  Scanning and Sequential Decision Making for Multidimensional Data—Part II: The Noisy Case , 2008, IEEE Transactions on Information Theory.

[32]  Jacob Ziv,et al.  On universal quantization , 1985, IEEE Trans. Inf. Theory.

[33]  Abraham Lempel,et al.  Compression of two-dimensional data , 1986, IEEE Trans. Inf. Theory.

[34]  Adam Krzyzak,et al.  Clipped median and space-filling curves in image filtering , 2001 .

[35]  Neri Merhav,et al.  Universal prediction of individual sequences , 1992, IEEE Trans. Inf. Theory.

[36]  Kuo-Liang Chung,et al.  Space-filling approach for fast window query on compressed images , 2000, IEEE Trans. Image Process..

[37]  Tsachy Weissman,et al.  On limited-delay lossy coding and filtering of individual sequences , 2002, IEEE Trans. Inf. Theory.

[38]  Neri Merhav,et al.  Universal Prediction , 1998, IEEE Trans. Inf. Theory.