CLRMA: Compact Low Rank Matrix Approximation for Data Compression

Low rank matrix approximation (LRMA) is a powerful technique for signal processing and pattern analysis. However, the performance of existing LRMA-based compression methods are still limited. In this paper, we propose compact low rank matrix approximation (CLRMA), a very effective tool for data compression, which extends the LRMA by exploring both the intra- and inter-coherence of data samples simultaneously. Technically, under the assistance of prescribed orthogonal transforms (such as such as discrete cosine/wavelet transform and graph transform), the CLRMA decomposes a matrix into a product of two smaller matrices so that one consists of extremely sparse and orthogonal column vectors, and the other is a transformed coefficient matrix for reconstruction. Numerically, we formulate the CLRMA problem by minimizing the $\ell_0$-norm and orthogonality regularized approximation (or reconstruction) error, and solve it by the inexact augmented Lagrangian multiplier method. We demonstrate the efficacy of CLMRA on various types of real-world data, including 3D meshes, image datasets, videos as well as human motion capture data, that is, the proposed CLRMA, in a much more compact form, can produce comparable approximation (or reconstruction) error as LRMA. Moreover, we present a CLRMA-based compression scheme for 3D dynamic meshes, and experimental results show that it outperforms the state-of-the-art scheme to a large extend in terms of compression performance.

[1]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Kannan Srinivasan,et al.  Data compression techniques for urban traffic data , 2013, 2013 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[3]  L. Vasa,et al.  CODDYAC: Connectivity Driven Dynamic Mesh Compression , 2007, 2007 3DTV Conference.

[4]  Sang Uk Lee,et al.  SNR and temporal scalable coding of 3-D mesh sequences using singular value decomposition , 2009, J. Vis. Commun. Image Represent..

[5]  Bruno Lévy,et al.  Spectral Mesh Processing , 2009, SIGGRAPH '10.

[6]  Nadia Magnenat-Thalmann,et al.  A Highly Efficient Compression Framework for Time-Varying 3-D Facial Expressions , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Jörn Ostermann,et al.  SPC: Fast and Efficient Scalable Predictive Coding of Animated Meshes , 2010, Comput. Graph. Forum.

[8]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[9]  YangCan,et al.  Low-Rank Modeling and Its Applications in Image Analysis , 2014 .

[10]  Ruye Wang,et al.  Introduction to Orthogonal Transforms: With Applications in Data Processing and Analysis , 2012 .

[11]  Jar-Ferr Yang,et al.  Combined techniques of singular value decomposition and vector quantization for image coding , 1995, IEEE Trans. Image Process..

[12]  Chang-Su Kim,et al.  Efficient Fine-Granular Scalable Coding of 3D Mesh Sequences , 2013, IEEE Transactions on Multimedia.

[13]  Ivan V. Bajic,et al.  Hybrid compression of dynamic 3D mesh data , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Václav Skala,et al.  COBRA: Compression of the Basis for PCA Represented Animations , 2009, Comput. Graph. Forum.

[15]  Libor Vása,et al.  Compressing dynamic meshes with geometric laplacians , 2014, Comput. Graph. Forum.

[16]  Pedro V. Sander,et al.  Geometry videos: a new representation for 3D animations , 2003, SCA '03.

[17]  Bu-Sung Lee,et al.  Low-Complexity Video Coding Based on Two-Dimensional Singular Value Decomposition , 2012, IEEE Transactions on Image Processing.

[18]  I. Markovsky Low-Rank Approximation , 2011, Communications and Control Engineering.

[19]  Rongjie Lai,et al.  A Splitting Method for Orthogonality Constrained Problems , 2014, J. Sci. Comput..

[20]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Zhang Yi,et al.  A Flow Volumes Data Compression Approach for Traffic Network Based on Principal Component Analysis , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[22]  Cha Zhang,et al.  Analyzing the Optimality of Predictive Transform Coding Using Graph-Based Models , 2013, IEEE Signal Processing Letters.

[23]  Kannan Srinivasan,et al.  Near-Lossless Compression for Large Traffic Networks , 2015, IEEE Transactions on Intelligent Transportation Systems.

[24]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[25]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[26]  K. R. Rao,et al.  A hybrid DWT-SVD image-coding system (HDWTSVD) for monochromatic images , 2003, IS&T/SPIE Electronic Imaging.

[27]  Hans-Peter Seidel,et al.  Motion capture using joint skeleton tracking and surface estimation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[29]  Yousef Saad,et al.  Trace optimization and eigenproblems in dimension reduction methods , 2011, Numer. Linear Algebra Appl..

[30]  K. R. Rao,et al.  The Transform and Data Compression Handbook , 2000 .

[31]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[32]  Nadia Magnenat-Thalmann,et al.  Compressing 3-D Human Motions via Keyframe-Based Geometry Videos , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Lei Zhang,et al.  A Cyclic Weighted Median Method for L1 Low-Rank Matrix Factorization with Missing Entries , 2013, AAAI.

[34]  Hongdong Li,et al.  A Simple Prior-Free Method for Non-rigid Structure-from-Motion Factorization , 2012, International Journal of Computer Vision.

[35]  Nadia Magnenat-Thalmann,et al.  Human Motion Capture Data Tailored Transform Coding , 2014, IEEE Transactions on Visualization and Computer Graphics.

[36]  Hongdong Li,et al.  Projective Multiview Structure and Motion from Element-Wise Factorization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Touradj Ebrahimi,et al.  JPEG2000: The upcoming still image compression standard , 2001, Pattern Recognit. Lett..

[38]  Libor V ´ ÿ Geometry-Driven Local Neighbourhood Based Predictors for Dynamic Mesh Compression , 2010 .

[39]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[40]  Philip A. Chou,et al.  Compression of human body sequences using graph Wavelet Filter Banks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Paolo Cignoni,et al.  Metro: Measuring Error on Simplified Surfaces , 1998, Comput. Graph. Forum.

[42]  Xiaoming Chen,et al.  Modeling and Compressing 3-D Facial Expressions Using Geometry Videos , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[44]  Libor Vása,et al.  Finding Optimal Parameter Configuration for a Dynamic Triangle Mesh Compressor , 2010, AMDO.

[45]  Chongyu Chen,et al.  Incremental low-rank and sparse decomposition for compressing videos captured by fixed cameras , 2015, J. Vis. Commun. Image Represent..