REV-AE: A Learned Frame Set for Image Reconstruction

Reversible residual network naturally extends the linear lifting scheme with no theoretic guarantee. In this paper, we propose a reversible autoencoder (Rev-AE) with this extended non-linear lifting scheme to improve image reconstruction. Nonlinear prediction and update operators are designed based on shallow convolutional neural networks to model multilayer non-linearities. Different from existing autoencoders, Rev-AE support efficient image reconstruction with parameters reusable for the symmetric encoder and decoder. Rev-AE forms a set of related frames to guarantee perfect reconstruction with the non-linear extension of classic lifting scheme. Lower and upper bounds are developed for the set of frames to relate with the singular values for each non-linear operator. Furthermore, we employ Rev-AE into lossy image compression to evaluate its effectiveness on image reconstruction. Experimental results show that Rev-AE achieves competitive performance in comparison to the state-of-the-art.

[1]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[2]  Richard G. Baraniuk,et al.  Nonlinear wavelet transforms for image coding via lifting , 2003, IEEE Trans. Image Process..

[3]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[4]  David Minnen,et al.  Joint Autoregressive and Hierarchical Priors for Learned Image Compression , 2018, NeurIPS.

[5]  Feng Wu,et al.  Adaptive Directional Lifting-Based Wavelet Transform for Image Coding , 2007, IEEE Transactions on Image Processing.

[6]  Henk J. A. M. Heijmans,et al.  Gradient-driven update lifting for adaptive wavelets , 2005, Signal Process. Image Commun..

[7]  Stéphane Mallat,et al.  Group Invariant Scattering , 2011, ArXiv.

[8]  Stéphane Mallat,et al.  Invariant Scattering Convolution Networks , 2012, IEEE transactions on pattern analysis and machine intelligence.

[9]  Wim Sweldens,et al.  Lifting scheme: a new philosophy in biorthogonal wavelet constructions , 1995, Optics + Photonics.

[10]  S. Mallat A wavelet tour of signal processing , 1998 .

[11]  Thomas Wiatowski,et al.  A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction , 2015, IEEE Transactions on Information Theory.

[12]  Arnold W. M. Smeulders,et al.  i-RevNet: Deep Invertible Networks , 2018, ICLR.

[13]  Philip M. Long,et al.  The Singular Values of Convolutional Layers , 2018, ICLR.

[14]  Michael Elad,et al.  Multilayer Convolutional Sparse Modeling: Pursuit and Dictionary Learning , 2017, IEEE Transactions on Signal Processing.

[15]  Raquel Urtasun,et al.  The Reversible Residual Network: Backpropagation Without Storing Activations , 2017, NIPS.

[16]  Luc Van Gool,et al.  Conditional Probability Models for Deep Image Compression , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Lubomir D. Bourdev,et al.  Real-Time Adaptive Image Compression , 2017, ICML.