Improving Wavelet Image Compression with Neural Networks

We explore the use of neural networks to predict wavelet coefficients for image compression. We show that by reducing the variance of the residual coefficients, the nonlinear prediction can be used to reduce the length of the compressed bitstream. We report results on several network architectures and training methodologies; some pitfalls of the approach are examined and explained. A two layer fully connected network, trained offline, applied to a test set consisting of seven 512 by 768 images from the Kodak database, gives a consequent overall improvement in the bit rate of between 4% and 7%.

[1]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[2]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[3]  B. Silverman,et al.  Nonparametric regression and generalized linear models , 1994 .

[4]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[5]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[6]  Michael T. Orchard,et al.  Image coding based on mixture modeling of wavelet coefficients and a fast estimation-quantization framework , 1997, Proceedings DCC '97. Data Compression Conference.

[7]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[8]  S. Mallat A wavelet tour of signal processing , 1998 .

[9]  Henrique S. Malvar Fast progressive wavelet coding , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[10]  Sheila S. Hemami,et al.  What's your sign?: efficient sign coding for embedded wavelet image coding , 2000, Proceedings DCC 2000. Data Compression Conference.

[11]  Pierre Moulin,et al.  Analysis of interscale and intrascale dependencies between image wavelet coefficients , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).