Ideal Code Constrained Supervised Sparse Coding

In this paper, we proposed a novel sparse codingalgorithm by using the class labels to constrain the learningof codebook and sparse code. We not only use the classlabel to train the classifier, but also use it to constructclass conditional codewords to make the sparse code asdiscriminative as possible. We first construct ideal sparsecodes with regarding to the class conditional codewords,and then constrain the learned sparse codes to the idealsparse codes. We proposed a novel loss function composed ofparse reconstruction error, classification error, and the idealsparse code constrain error. This problem can be optimizedby using the transitional KSVD method. In this way, wemay learn a discriminative classifier and a discriminativecodebook simultaneously. Moreover, using this codebook, thelearnt the sparse codes of the same class are similar to eachother. Finally, exhaustive experimental results show thatthe proposed algorithm outperforms other sparse codingmethods.

[1]  Angel Domingo Sappa,et al.  A Novel Space Variant Image Representation , 2012, Journal of Mathematical Imaging and Vision.

[2]  K. Vidhya,et al.  A Novel Threshold Approach for Medical Image Compression , 2013 .

[3]  Shengping Zhang,et al.  Sparse coding based visual tracking: Review and experimental comparison , 2013, Pattern Recognit..

[4]  Christian Wolf,et al.  Supervised Learning and Codebook Optimization for Bag-of-Words Models , 2012, Cognitive Computation.

[5]  Jian-Xun Mi Face image recognition via collaborative representation on selected training samples , 2013 .

[6]  M Mitra,et al.  ECG beat classification based on discrete wavelet transformation and nearest neighbour classifier , 2013, Journal of medical engineering & technology.

[7]  Larry S. Davis,et al.  Discriminative Dictionary Learning with Pairwise Constraints , 2012, ACCV.

[8]  Milan Hladík,et al.  On the possibilistic approach to linear regression models involving uncertain, indeterminate or interval data , 2013, Inf. Sci..

[9]  Tien Yin Wong,et al.  Learn to recognize pathological myopia in fundus images using bag-of-feature and sparse learning approach , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[10]  Thangavelu Kesavamurthy,et al.  Lossless color medical image compression using adaptive block-based encoding for human computed tomographic images , 2013, Int. J. Imaging Syst. Technol..

[11]  Jie Xu,et al.  QSPR analysis for melting point of fatty acids using genetic algorithm based multiple linear regression (GA-MLR) , 2013 .

[12]  Karthikeyan Natesan Ramamurthy,et al.  Learning dictionaries with graph embedding constraints , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[13]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[14]  Jim Jing-Yan Wang,et al.  Joint learning and weighting of visual vocabulary for bag-of-feature based tissue classification , 2013, Pattern Recognit..

[15]  Jian Yang,et al.  Complete large margin linear discriminant analysis using mathematical programming approach , 2013, Pattern Recognit..

[16]  R. S. Anand,et al.  Lossless Compression of Medical Images Using a Dual Level DPCM with Context Adaptive Switching Neural Network Predictor , 2013, Int. J. Comput. Intell. Syst..

[17]  G. G. Sarate,et al.  Handwritten Devnagari consonants recognition using MLPNN with five fold cross validation , 2013, 2013 International Conference on Circuits, Power and Computing Technologies (ICCPCT).

[18]  Peng Li,et al.  Hashing with dual complementary projection learning for fast image retrieval , 2013, Neurocomputing.

[19]  K. Kashihara,et al.  Classification of individually pleasant images based on neural networks with the bag of features , 2013, 2013 1st International Conference on Orange Technologies (ICOT).

[20]  Dylan Mikesell,et al.  Using SVD for Improved Interferometric Green's Function Retrieval , 2013 .

[21]  Amaury Lendasse,et al.  Fast Face Recognition Via Sparse Coding and Extreme Learning Machine , 2013, Cognitive Computation.

[22]  Jiashi Feng,et al.  Multi-class learning from class proportions , 2013, Neurocomputing.

[23]  Mohammad Reza Mohammadizadeh,et al.  Simultaneous spectrophotometric determination of Cd2+, Cu2+, and Zn2+ in rice and vegetal samples with dimethyl-spiro[isobenzofurane-1,6'-pyrorolo[2,3-d]pyrimidine]-2',3,4,5'(1'H,3'H,7'H)tetraone using wavelet transformation-feed forward neural networks. , 2013, Journal of agricultural and food chemistry.

[24]  Figen Kadirgan,et al.  Understanding the influence of Ni, Co, Rh and Pd addition to PtSn/C catalyst for the oxidation of ethanol by in situ Fourier transform infrared spectroscopy , 2014 .

[25]  Aykut Erdem,et al.  Group sparsity based sparse coding for region covariances , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[26]  Xu-Qing Liu,et al.  Non-Diagonal-Type Estimator in Linear Regression , 2014, Commun. Stat. Simul. Comput..

[27]  Sivakolundu Jayasekara,et al.  A Novel Image Retrieval System Based on Histogram Factorization and Contextual Similarity Learning , 2013 .

[28]  Azeddine Beghdadi,et al.  Wave atoms based compression method for fingerprint images , 2013, Pattern Recognit..

[29]  Aloysius George,et al.  Efficient high dimension data clustering using constraint-partitioning k-means algorithm , 2013, Int. Arab J. Inf. Technol..

[30]  Qi Tian,et al.  Laplacian affine sparse coding with tilt and orientation consistency for image classification , 2013, J. Vis. Commun. Image Represent..

[31]  Ana Colubi,et al.  A set arithmetic-based linear regression model for modelling interval-valued responses through real-valued variables , 2013, Inf. Sci..

[32]  Guodong Liu,et al.  Radioactive Quality Evaluation and Cross Validation of Data from the HJ-1A/B Satellites' CCD Sensors , 2013, Sensors.

[33]  Claudio Gennaro,et al.  On Reducing the Number of Visual Words in the Bag-of-Features Representation , 2013, VISAPP.

[34]  James Theiler,et al.  SIFT-based Sparse Coding for Large-scale Visual Recognition , 2013 .

[35]  Hakan Cevikalp,et al.  Hyperdisk based large margin classifier , 2013, Pattern Recognit..

[36]  Ji Lin Wang Wavelet Digital Watermarking Algorithm on the Basis of SVD Decomposition , 2013 .

[37]  Nicolas Le Bihan,et al.  Instantaneous frequency and amplitude of orthocomplex modulated signals based on quaternion Fourier transform , 2012, Signal Process..

[38]  Joaquín Abellán An application of Non-Parametric Predictive Inference on multi-class classification high-level-noise problems , 2013, Expert Syst. Appl..

[39]  Aslam Muhammad,et al.  Efficient Estimation and Robust Inference of Linear Regression Models in the Presence of Heteroscedastic Errors and High Leverage Points , 2013, Commun. Stat. Simul. Comput..

[40]  Jie Cao,et al.  A novel noise filter based on interesting pattern mining for bag-of-features images , 2013, Expert Syst. Appl..

[41]  Uwe Petersohn,et al.  Large margin principle in hyperrectangle learning , 2014, Neurocomputing.

[42]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[43]  Shuyuan Yang,et al.  Superpixel-wise semi-supervised structural sparse coding classifier for image segmentation , 2013, Eng. Appl. Artif. Intell..

[44]  Shigeru Katagiri,et al.  Robust and Efficient Pattern Classification using Large Geometric Margin Minimum Classification Error Training , 2014, J. Signal Process. Syst..

[45]  Li Xiao,et al.  A sample-based hierarchical adaptive K-means clustering method for large-scale video retrieval , 2013, Knowl. Based Syst..

[46]  Chang Wook Ahn,et al.  An optimized watermarking technique based on self-adaptive DE in DWT-SVD transform domain , 2014, Signal Process..

[47]  Yooil Kim Rapid response calculation of LNG cargo containment system under sloshing load using wavelet transformation , 2013 .

[48]  Jiye Liang,et al.  Fast global k-means clustering based on local geometrical information , 2013, Inf. Sci..

[49]  Yinghua Han,et al.  Compressive sensing of block-sparse signals recovery based on sparsity adaptive regularized orthogonal matching pursuit algorithm , 2012, 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI).

[50]  Shutao Li,et al.  Multi-morphology image super-resolution via sparse representation , 2013, Neurocomputing.

[51]  Jim Jing-Yan Wang,et al.  Discriminative sparse coding on multi-manifolds , 2013, Knowl. Based Syst..

[52]  Y. Korin,et al.  Standardization and Cross Validation of Alloreactive IFNγ ELISPOT Assays Within the Clinical Trials in Organ Transplantation Consortium , 2013, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[53]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Kemal Polat Data weighting method on the basis of binary encoded output to solve multi-class pattern classification problems , 2013, Expert Syst. Appl..

[55]  Zhuowen Tu,et al.  Randomness and sparsity induced codebook learning with application to cancer image classification , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[56]  Wen Gao,et al.  Learning multiple codebooks for low bit rate mobile visual search , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[57]  Marykutty Cyriac,et al.  A Wavelet Based Approach for Near-Lossless Image Compression Using Logarithmic Transformation , 2013 .

[58]  Abdul Rauf Baig,et al.  Two-stage learning for multi-class classification using genetic programming , 2013, Neurocomputing.

[59]  Guan Gui,et al.  MIP-Mitigated Sparse Channel Estimation Using Orthogonal Matching Pursuit Algorithm , 2013 .

[60]  Xinmei Tian,et al.  Discriminative codebook learning for Web image search , 2013, Signal Process..

[61]  Guang Yang,et al.  L 1 Graph Based on Sparse Coding for Feature Selection , 2013, ISNN.

[62]  Xi Zhang,et al.  Feature integration analysis of bag-of-features model for image retrieval , 2013, Neurocomputing.

[63]  Bin Fang,et al.  Large Margin Subspace Learning for feature selection , 2013, Pattern Recognit..

[64]  Mary F. Wheeler,et al.  An Ensemble Based Nonlinear Orthogonal Matching Pursuit Algorithm for Sparse History Matching of Reservoir Models , 2013, ANSS 2013.

[65]  Dan Li,et al.  A Fast Approximate Sparse Coding Networks and Application to Image Denoising , 2013, ISNN.

[66]  Hideitsu Hino,et al.  Learning Ancestral Atom via Sparse Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[67]  Baochang Zhang,et al.  Spatial Weighting for Bag-of-Features Based Image Retrieval , 2013, IUKM.

[68]  Sukadev Meher,et al.  A Hybrid Image Compression Scheme Using DCT and Fractal Image Compression , 2013, Int. Arab J. Inf. Technol..

[69]  Shuyuan Yang,et al.  Data-Driven Compressive Sampling and Learning Sparse Coding for Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[70]  Qi Tian,et al.  Weakly supervised codebook learning by iterative label propagation with graph quantization , 2013, Signal Process..

[71]  Sudipta Mukhopadhyay,et al.  Rotation invariant textural feature extraction for image retrieval using eigen value analysis of intensity gradients and multi-resolution analysis , 2013, Pattern Recognit..

[72]  V. Sowmya,et al.  An experimental study on application of Orthogonal Matching Pursuit algorithm for image denoising , 2013, 2013 International Mutli-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s).

[73]  Tieli Sun,et al.  An efficient hybrid data clustering method based on K-harmonic means and Particle Swarm Optimization , 2009, Expert Syst. Appl..

[74]  Michael Elad,et al.  K-SVD : DESIGN OF DICTIONARIES FOR SPARSE REPRESENTATION , 2005 .

[75]  Ruimin Hu,et al.  Face Image Superresolution via Locality Preserving Projection and Sparse Coding , 2013, J. Softw..

[76]  Fengtao Xiang,et al.  Image reconstruction based on sparse and redundant representation model: Local vs nonlocal , 2013 .

[77]  Alessandro Sbrizzi,et al.  Transmit and receive RF fields determination from a single low‐tip‐angle gradient‐echo scan by scaling of SVD data , 2014, Magnetic resonance in medicine.

[78]  Zihan Zhou,et al.  Demo: Robust face recognition via sparse representation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[79]  Kuwat Triyana,et al.  Analysis of lard in meatball broth using Fourier transform infrared spectroscopy and chemometrics. , 2014, Meat science.

[80]  Juliano B. Lima,et al.  Image encryption based on the fractional Fourier transform over finite fields , 2014, Signal Process..