Quantum-enhanced feature selection with forward selection and backward elimination

Feature selection is a well-known preprocessing technique in machine learning, which can remove irrelevant features to improve the generalization capability of a classifier and reduce training and inference time. However, feature selection is time-consuming, particularly for the applications those have thousands of features, such as image retrieval, text mining and microarray data analysis. It is crucial to accelerate the feature selection process. We propose a quantum version of wrapper-based feature selection, which converts a classical feature selection to its quantum counterpart. It is valuable for machine learning on quantum computer. In this paper, we focus on two popular kinds of feature selection methods, i.e., wrapper-based forward selection and backward elimination. The proposed feature selection algorithm can quadratically accelerate the classical one.

[1]  Yue Hu,et al.  Handling High-Dimension (High-Feature) MicroRNA Data. , 2017, Methods in molecular biology.

[2]  David Horn,et al.  Analyzing Big Data with Dynamic Quantum Clustering , 2013, ArXiv.

[3]  Ping Li,et al.  Hashing Algorithms for Large-Scale Learning , 2011, NIPS.

[4]  Shenggen Zheng,et al.  Application of distributed semi-quantum computing model in phase estimation , 2017, Inf. Process. Lett..

[5]  Gilles Brassard,et al.  Quantum speed-up for unsupervised learning , 2012, Machine Learning.

[6]  Richard Weber,et al.  A wrapper method for feature selection using Support Vector Machines , 2009, Inf. Sci..

[7]  Karl Stratos,et al.  Large Scale Retrieval and Generation of Image Descriptions , 2015, International Journal of Computer Vision.

[8]  Yungho Leu,et al.  A novel hybrid feature selection method for microarray data analysis , 2011, Appl. Soft Comput..

[9]  Dan Ventura,et al.  Quantum Neural Networks , 2000 .

[10]  David Kim,et al.  Feature Selection Methods for Improving Protein Structure Prediction with Rosetta , 2007, NIPS.

[11]  S. Lloyd,et al.  Quantum principal component analysis , 2013, Nature Physics.

[12]  Ashish Kapoor,et al.  Quantum deep learning , 2014, Quantum Inf. Comput..

[13]  C-Y Lu,et al.  Entanglement-based machine learning on a quantum computer. , 2015, Physical review letters.

[14]  K.Z. Mao,et al.  Orthogonal forward selection and backward elimination algorithms for feature subset selection , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Yang Liu,et al.  Fast quantum algorithms for least squares regression and statistic leverage scores , 2015, Theor. Comput. Sci..

[16]  Songfeng Lu,et al.  Quantum decision tree classifier , 2014, Quantum Inf. Process..

[17]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[18]  Lingli Wang,et al.  A quantum-implementable neural network model , 2017, Quantum Inf. Process..

[19]  F. Petruccione,et al.  An introduction to quantum machine learning , 2014, Contemporary Physics.

[20]  Ting Yu,et al.  Generalized coherent states, reproducing kernels, and quantum support vector machines , 2016, Quantum Inf. Comput..

[21]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[22]  Michel Verleysen,et al.  Mutual information-based feature selection for multilabel classification , 2013, Neurocomputing.

[23]  Jiangfeng Du,et al.  Experimental realization of a quantum support vector machine. , 2015, Physical review letters.

[24]  Charles H. Bennett,et al.  Logical reversibility of computation , 1973 .

[25]  Gil Alterovitz,et al.  Accelerating wrapper-based feature selection with K-nearest-neighbor , 2015, Knowl. Based Syst..

[26]  A. Harrow,et al.  Quantum algorithm for linear systems of equations. , 2008, Physical review letters.

[27]  Chao-Hua Yu,et al.  Quantum algorithm for association rules mining , 2015, 1512.02420.

[28]  Bin Liu,et al.  A Generic Construction of Quantum-Oblivious-Key-Transfer-Based Private Query with Ideal Database Security and Zero Failure , 2017, IEEE Transactions on Computers.

[29]  Enrique Alba,et al.  Two hybrid wrapper-filter feature selection algorithms applied to high-dimensional microarray experiments , 2016, Appl. Soft Comput..

[30]  Ying Liu,et al.  Quantum algorithm for support matrix machines , 2017 .

[31]  Masoud Mohseni,et al.  Quantum support vector machine for big feature and big data classification , 2013, Physical review letters.

[32]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[33]  Tzyh Jong Tarn,et al.  Quantum Reinforcement Learning , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Yue Ruan,et al.  Quantum Algorithm for K-Nearest Neighbors Classification Based on the Metric of Hamming Distance , 2017, International Journal of Theoretical Physics.

[35]  Gexiang Zhang,et al.  Resemblance Coefficient and a Quantum Genetic Algorithm for Feature Selection , 2004, Discovery Science.

[36]  Gilles Brassard,et al.  Tight bounds on quantum searching , 1996, quant-ph/9605034.

[37]  Steven H. Adachi,et al.  Application of Quantum Annealing to Training of Deep Neural Networks , 2015, ArXiv.

[38]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[39]  Zonghai Chen,et al.  QUANTUM COMPUTATION FOR ACTION SELECTION USING REINFORCEMENT LEARNING , 2006 .

[40]  Jian-Wei Pan,et al.  Experimental realization of quantum algorithm for solving linear systems of equations , 2013, 1302.1946.