Quantum Relief algorithm

Relief algorithm is a feature selection algorithm used in binary classification proposed by Kira and Rendell, and its computational complexity remarkably increases with both the scale of samples and the number of features. In order to reduce the complexity, a quantum feature selection algorithm based on Relief algorithm, also called quantum Relief algorithm, is proposed. In the algorithm, all features of each sample are superposed by a certain quantum state through the CMP and rotation operations, then the swap test and measurement are applied on this state to get the similarity between two samples. After that, Near-hit and Near-miss are obtained by calculating the maximal similarity, and further applied to update the feature weight vector WT to get $${\overline{WT}}$$WT¯ that determine the relevant features with the threshold $$\tau $$τ. In order to verify our algorithm, a simulation experiment based on IBM Q with a simple example is performed. Efficiency analysis shows the computational complexity of our proposed algorithm is O(M), while the complexity of the original Relief algorithm is O(NM), where N is the number of features for each sample, and M is the size of the sample set. Obviously, our quantum Relief algorithm has superior acceleration than the classical one.

[1]  Chen Lei,et al.  Multi-support vector machine power system transient stability assessment based on relief algorithm , 2015, 2015 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[2]  Hartmut Neven,et al.  Training a Large Scale Classifier with the Quantum Adiabatic Algorithm , 2009, ArXiv.

[3]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[4]  N. Amjady,et al.  Day-ahead electricity price forecasting using the relief algorithm and neural networks , 2008, 2008 5th International Conference on the European Electricity Market.

[5]  Masahide Sasaki,et al.  Quantum learning and universal quantum matching machine , 2002 .

[6]  D. Deutsch,et al.  Rapid solution of problems by quantum computation , 1992, Proceedings of the Royal Society of London. Series A: Mathematical and Physical Sciences.

[7]  Davide Anguita,et al.  Quantum optimization for training support vector machines , 2003, Neural Networks.

[8]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[9]  Mingguo Zhao,et al.  A Fast Algorithm for Hand Gesture Recognition Using Relief , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[10]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[11]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .

[12]  R. Cleve,et al.  Quantum fingerprinting. , 2001, Physical review letters.

[13]  Ashish Kapoor,et al.  Quantum algorithms for nearest-neighbor methods for supervised and unsupervised learning , 2014, Quantum Inf. Comput..

[14]  S. Lloyd Quantum-Mechanical Computers , 1995 .

[15]  D. Deutsch Quantum theory, the Church–Turing principle and the universal quantum computer , 1985, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[16]  S. Lloyd,et al.  Quantum algorithms for supervised and unsupervised machine learning , 2013, 1307.0411.

[17]  Marko Robnik-Sikonja,et al.  An adaptation of Relief for attribute estimation in regression , 1997, ICML.

[18]  Lov K. Grover A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[19]  Marko Robnik-Sikonja,et al.  Overcoming the Myopia of Inductive Learning Algorithms with RELIEFF , 2004, Applied Intelligence.

[20]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2022 .

[21]  Alexander Hentschel,et al.  Machine learning for precise quantum measurement. , 2009, Physical review letters.

[22]  Daniel A. Lidar,et al.  Quantum adiabatic machine learning , 2011, Quantum Inf. Process..

[23]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[24]  Rocco A. Servedio,et al.  Equivalences and Separations Between Quantum and Classical Learnability , 2004, SIAM J. Comput..

[25]  Peter W. Shor,et al.  Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1995, SIAM Rev..