Performance bounds of compressive classification under perturbation

Abstract Recently, compressive sensing based classification, which is called compressive classification, has drawn a lot of attention, since it works directly in the compressive domain with low complexity. However, existing literatures assume perfectly known measurement matrix during compressive classification, which is impossible in many practical situations. In this paper, we focus on studying the performance of classification based on the compressive measurements under the perturbation, where the perturbation models the uncertainty of the measurement matrix. The upper and the lower bounds on the probability of misclassification of the compressive classification are evaluated by utilizing the Kullback-Leibler and Chernoff distances. Our results indicate that the performance depends on the variance of the perturbation when the perturbation obeys Gaussian distribution with zero mean. Moreover, compared with the one without perturbation, the performance of the compressive classification can be improved when the perturbation in each hypothesis is different from each other. Motivated by these observations, we design an improved sparse representation classification (SRC) framework by incorporating the perturbation item into the SRC framework and propose several enhanced SRC schemes for performance improvement. The experiments on MNIST datasets validate that the proposed SRC schemes outperform the existing standard SRC scheme.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Siye Wang,et al.  Feature selection and classification of noisy proteomics mass spectrometry data based on one-bit perturbed compressed sensing , 2020, Bioinform..

[3]  Yun Tian,et al.  Perturbation analysis of simultaneous orthogonal matching pursuit , 2015, Signal Process..

[4]  Qin Yang,et al.  Sparse classification of rotating machinery faults based on compressive sensing strategy , 2015 .

[5]  Lei Yang,et al.  A Perturbation-Based Approach for Compressed Sensing Radar Imaging , 2017, IEEE Antennas and Wireless Propagation Letters.

[6]  Duncan Fyfe Gillies,et al.  A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data , 2015, Adv. Bioinformatics.

[7]  Nilanjan Ray,et al.  Object Classification With Joint Projection and Low-Rank Dictionary Learning , 2016, IEEE Transactions on Image Processing.

[8]  Yue Wang,et al.  Enabling Technologies for Spectrum and Energy Efficient NOMA-MmWave-MaMIMO Systems , 2020, IEEE Wireless Communications.

[9]  Chinmay Hegde,et al.  Compressive image acquisition and classification via secant projections , 2015 .

[10]  Pavan K. Turaga,et al.  Reconstruction-Free Action Inference from Compressive Imagers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Richard G. Baraniuk,et al.  Signal Processing With Compressive Measurements , 2010, IEEE Journal of Selected Topics in Signal Processing.

[12]  J. Haupt,et al.  Compressive Sampling for Signal Classification , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[13]  Zhi Tian,et al.  Big Data in 5G , 2020, Encyclopedia of Wireless Networks.

[14]  Naif Alajlan,et al.  Land-Use Classification With Compressive Sensing Multifeature Fusion , 2015, IEEE Geoscience and Remote Sensing Letters.

[15]  Yongsheng Ding,et al.  A new method using the convolutional neural network with compressive sensing for fabric defect classification based on small sample sizes , 2018, Textile Research Journal.

[16]  Xiaobo Zhang,et al.  Recovery Performance of IHT and HTP Algorithms under General Perturbations , 2018, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[17]  Ying Wen,et al.  Sparse Low-Rank Component Coding for Face Recognition with Illumination And Corruption , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  A. Robert Calderbank,et al.  Bounds on the Number of Measurements for Reliable Compressive Classification , 2016, IEEE Transactions on Signal Processing.

[19]  Richard G. Baraniuk,et al.  Multiscale Random Projections for Compressive Classification , 2007, 2007 IEEE International Conference on Image Processing.

[20]  Xin Wang,et al.  Compressive wireless data transmissions under channel perturbation , 2014, 2014 Eleventh Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[21]  Pascal Larzabal,et al.  Compressed Sensing with Basis Mismatch: Performance Bounds and Sparse-Based Estimator , 2016, IEEE Transactions on Signal Processing.

[22]  Farid Melgani,et al.  Land-Cover Classification of Remotely Sensed Images Using Compressive Sensing Having Severe Scarcity of Labeled Patterns , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Thomas Strohmer,et al.  General Deviants: An Analysis of Perturbations in Compressed Sensing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[24]  A. Robert Calderbank,et al.  Sensitivity to Basis Mismatch in Compressed Sensing , 2011, IEEE Trans. Signal Process..

[25]  Guoqi Liu,et al.  An Improved Analysis for Support Recovery With Orthogonal Matching Pursuit Under General Perturbations , 2018, IEEE Access.

[26]  Cishen Zhang,et al.  Robustly Stable Signal Recovery in Compressed Sensing With Structured Matrix Perturbation , 2011, IEEE Transactions on Signal Processing.

[27]  Saurabh Prasad,et al.  Sparse representation-based classification: Orthogonal least squares or orthogonal matching pursuit? , 2016, Pattern Recognit. Lett..

[28]  Yue Wang,et al.  A hardware implementation of random demodulation analog-to-information converter , 2016, IEICE Electron. Express.

[29]  Rama Chellappa,et al.  IEEE TRANSACTIONS ON SIGNAL PROCESSING 1 Analysis of Sparse Regularization Based Robust Regression Approaches , 2022 .

[30]  Asoke K. Nandi,et al.  Compressive sensing strategy for classification of bearing faults , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[32]  Yuantao Gu,et al.  On the Performance Bound of Sparse Estimation With Sensing Matrix Perturbation , 2012, IEEE Transactions on Signal Processing.

[33]  Yanli Wang,et al.  Device-Free Localization Based on Spatial Sparsity with Basis Error Self-Calibration , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[34]  Pramod K. Varshney,et al.  Performance Limits of Compressive Sensing-Based Signal Classification , 2012, IEEE Transactions on Signal Processing.

[35]  Yong Shi,et al.  ν-Nonparallel support vector machine for pattern classification , 2014, Neural Computing and Applications.

[36]  Philipp Zhang,et al.  Information estimations and acquisition costs for quantized compressive sensing , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[37]  Richard G. Baraniuk,et al.  The smashed filter for compressive classification and target recognition , 2007, Electronic Imaging.

[38]  A. Robert Calderbank,et al.  Compressive classification , 2013, 2013 IEEE International Symposium on Information Theory.

[39]  Yun Tian,et al.  Improved analysis of orthogonal matching pursuit in general perturbations , 2017 .

[40]  Tieniu Tan,et al.  Representative Vector Machines: A Unified Framework for Classical Classifiers , 2016, IEEE Transactions on Cybernetics.

[41]  Sergio Verdú,et al.  Generalizing the Fano inequality , 1994, IEEE Trans. Inf. Theory.

[42]  Yun Tian,et al.  Perturbed block orthogonal matching pursuit , 2018, Electronics Letters.

[43]  Dustin G. Mixon,et al.  Compressive classification and the rare eclipse problem , 2014, ArXiv.

[44]  Pramod K. Varshney,et al.  Compressive Sensing Based Classification in the Presence of Intra-and Inter-Signal Correlation , 2018, IEEE Signal Processing Letters.

[45]  Khaled A. Harras,et al.  Multimodal Deep Learning Approach for Joint EEG-EMG Data Compression and Classification , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[46]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[47]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[48]  Jian Wang,et al.  Reconstruction-free inference on compressive measurements , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[49]  Tara N. Sainath,et al.  Bayesian compressive sensing for phonetic classification , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[50]  Yue Wang,et al.  Performance limits of one-bit compressive classification , 2021, Signal Process..

[51]  Jing Yuan,et al.  Noise Folding in Completely Perturbed Compressed Sensing , 2016, J. Appl. Math..

[52]  Yue Wang,et al.  A Two-Step Compressed Spectrum Sensing Scheme for Wideband Cognitive Radios , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[53]  Yue Wang,et al.  Super-Resolution Channel Estimation for Arbitrary Arrays in Hybrid Millimeter-Wave Massive MIMO Systems , 2019, IEEE Journal of Selected Topics in Signal Processing.

[54]  Chunyan Feng,et al.  Sparsity Order Estimation and its Application in Compressive Spectrum Sensing for Cognitive Radios , 2012, IEEE Transactions on Wireless Communications.

[55]  Xuemei Guo,et al.  A Novel Infrared Motion Sensing System for Compressive Classification of Physical Activity , 2016, IEEE Sensors Journal.

[56]  Yue Wang,et al.  Angle-Based Channel Estimation with Arbitrary Arrays , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[57]  Ali Cafer Gürbüz,et al.  Perturbed Orthogonal Matching Pursuit , 2013, IEEE Transactions on Signal Processing.

[58]  A. Robert Calderbank,et al.  Classification and Reconstruction of High-Dimensional Signals From Low-Dimensional Features in the Presence of Side Information , 2014, IEEE Transactions on Information Theory.