A Quantum Feature Selection Algorithm for Multi-Classification Problem

ReliefF is a feature selection algorithm for the multi-classification problem, and its complexity of the algorithm grows rapidly as the number of samples and features increases. In order to reduce the complexity, a quantum-based feature selection algorithm for the multi-classification problem, also called QReliefF algorithm, is proposed. Firstly, all features of each sample are encoded into the quantum state by CMP and rotation operation for similarity calculation. After that, the similarity is encoded into a quantum state using the amplitude estimation, the nearest k neighbor samples in each class are found by Grover method, and are used to update the weight vector. Finally, the features are selected according to the final weight vector and threshold. Compared with the classical ReliefF algorithm, our algorithm changes from O(MN) to O(M) in terms of the complexity of similarity calculation and the complexity of finding the nearest neighbor is changed from O(M) to O(√ M). Our algorithm consumes O(MlogN) qubits in terms of resource consumption, while the ReliefF algorithm consumes O(MN) bits. Obviously, our algorithm is better than the ReliefF algorithm in efficiency and resource consumption.

[1]  Ashish Kapoor,et al.  Quantum algorithms for nearest-neighbor methods for supervised and unsupervised learning , 2014, Quantum Inf. Comput..

[2]  Alfredo Cuzzocrea,et al.  A novel GPU-aware Histogram-based algorithm for supporting moving object segmentation in big-data-based IoT application scenarios , 2019, Inf. Sci..

[3]  C. Ding,et al.  Gene selection algorithm by combining reliefF and mRMR , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[4]  Naveen K. Chilamkurti,et al.  In-Mapper combiner based MapReduce algorithm for processing of big climate data , 2018, Future Gener. Comput. Syst..

[5]  Maria Schuld,et al.  The quest for a Quantum Neural Network , 2014, Quantum Information Processing.

[6]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[7]  Lov K. Grover.  Quantum Mechanics Helps in Searching for a Needle in a Haystack , 1997, quant-ph/9706033.

[8]  J. Koenderink.  Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[9]  Chris H. Q. Ding,et al.  Multi-label ReliefF and F-statistic feature selections for image annotation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Laurence T. Yang,et al.  A Distributed HOSVD Method With Its Incremental Computation for Big Data in Cyber-Physical-Social Systems , 2018, IEEE Transactions on Computational Social Systems.

[11]  Laurence T. Yang,et al.  A Tensor-Based Big-Data-Driven Routing Recommendation Approach for Heterogeneous Networks , 2019, IEEE Network.

[12]  Christoph Dürr,et al.  A Quantum Algorithm for Finding the Minimum , 1996, ArXiv.

[13]  Peter W. Shor,et al.  Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1995, SIAM Rev..

[14]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[15]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[16]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2007 .

[17]  Ching-Nung Yang,et al.  Quantum Relief algorithm , 2018, Quantum Information Processing.

[18]  P. Benioff.  The computer as a physical system: A microscopic quantum mechanical Hamiltonian model of computers as represented by Turing machines , 1980 .

[19]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[20]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[21]  Jason H Moore,et al.  Epistasis analysis using ReliefF. , 2015, Methods in molecular biology.

[22]  Masahide Sasaki,et al.  Quantum learning and universal quantum matching machine , 2002 .

[23]  Davide Anguita,et al.  Quantum optimization for training support vector machines , 2003, Neural Networks.