Quantum Transfer Learning for Real-World, Small, and High-Dimensional Datasets

—Quantum machine learning (QML) networks promise to have some computational (or quantum ) advantage for classifying supervised datasets (e.g., satellite images) over some conventional deep learning (DL) techniques due to their expressive power via their local effective dimension. There are, however, two main challenges regardless of the promised quantum advantage: 1) Currently available quantum bits (qubits) are very small in number, while real-world datasets are characterized by hundreds of high-dimensional elements (i.e., features). Addi- tionally, there is not a single unified approach for embedding real-world high-dimensional datasets in a limited number of qubits. 2) Some real-world datasets are too small for training intricate QML networks. Hence, to tackle these two challenges for bench- marking and validating QML networks on real-world, small, and high-dimensional datasets in one-go, we employ quantum transfer learning composed of a multi-qubit QML network, and a very deep convolutional network (a with VGG16 architecture) extracting informative features from any small, high-dimensional dataset. We use real-amplitude and strongly-entangling N-layer QML networks with and without data re-uploading layers as a multi-qubit QML network, and evaluate their expressive power quantified by using their local effective dimension ; the lower the local effective dimension of a QML network, the better its performance on unseen data. Therefore, we first compute the local effective dimension of these QML networks on Eurosat and synthetic datasets, because we can encode these datasets efficiently in a few qubits, and their local effective dimension should correlate with their classification performance. To validate this correlation, we then benchmarked and trained the QML networks via quantum transfer learning on the real-world, small, and high-dimensional three-class labelling problem (i.e., hard-to-classify images) of a UC Merced Land Use dataset, (a dense residential , medium residential , and sparse residential area image recognition and labelling problem), because this three-class dataset meets the two challenges mentioned above: 1) its data points are characterized by 256 × 256 × 3 elements (i.e., a high-dimensional image), and 2) this dataset consists of only 288 image scenes (i.e., a small dataset). Our numerical results show that the strongly-entangling N-layer QML network has a lower local effective dimension than the real-amplitude QML network and outperforms it on the hard-to-classify three-class labelling problem. In addition, quantum transfer learning helps tackle the two challenges mentioned above for benchmarking and validating QML networks on real-world, small, and high-dimensional datasets.

[1]  Dario Spiller,et al.  On Circuit-Based Hybrid Quantum Neural Networks for Remote Sensing Imagery Classification , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Mihai Datcu,et al.  Classification of Remote Sensing Images With Parameterized Quantum Gates , 2022, IEEE Geoscience and Remote Sensing Letters.

[3]  Stefan Woerner,et al.  Effective dimension of machine learning models , 2021, ArXiv.

[4]  Sofia Vallecorsa,et al.  Hybrid quantum classical graph neural networks for particle track reconstruction , 2021, Quantum Machine Intelligence.

[5]  Pavlo O. Dral,et al.  Artificial intelligence-enhanced quantum chemical method with broad applicability , 2021, Nature Communications.

[6]  Johannes Jakob Meyer,et al.  Fisher Information in Noisy Intermediate-Scale Quantum Applications , 2021, Quantum.

[7]  M. Kim,et al.  Capacity and quantum geometry of parametrized quantum circuits , 2021, PRX Quantum.

[8]  H. Neven,et al.  Power of data in quantum machine learning , 2020, Nature Communications.

[9]  Stefan Woerner,et al.  The power of quantum neural networks , 2020, Nature Computational Science.

[10]  D. Lucchesi,et al.  Quantum-inspired machine learning on high-energy physics data , 2020, npj Quantum Information.

[11]  M. Datcu,et al.  Natural Embedding of the Stokes Parameters of Polarimetric Synthetic Aperture Radar Images in a Gate-Based Quantum Computer , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Gong Cheng,et al.  Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Ievgeniia Oshurko Quantum Machine Learning , 2020, Quantum Computing.

[14]  Gregory W. Benton,et al.  Rethinking Parameter Counting in Deep Models: Effective Dimensionality Revisited , 2020, ArXiv.

[15]  S. Lloyd,et al.  Quantum embeddings for machine learning , 2020, 2001.03622.

[16]  Nathan Killoran,et al.  Transfer learning in hybrid classical-quantum neural networks , 2019, Quantum.

[17]  Jos'e I. Latorre,et al.  Data re-uploading for a universal quantum classifier , 2019, Quantum.

[18]  Tongliang Liu,et al.  Expressive power of parametrized quantum circuits , 2020 .

[19]  Maria Schuld,et al.  Quantum Machine Learning in Feature Hilbert Spaces. , 2018, Physical review letters.

[20]  Andreas Dengel,et al.  EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Ryan Babbush,et al.  Barren plateaus in quantum neural network training landscapes , 2018, Nature Communications.

[22]  Nathan Killoran,et al.  PennyLane: Automatic differentiation of hybrid quantum-classical computations , 2018, ArXiv.

[23]  John Preskill,et al.  Quantum Computing in the NISQ era and beyond , 2018, Quantum.

[24]  Hans-J. Briegel,et al.  Machine learning \& artificial intelligence in the quantum domain , 2017, ArXiv.

[25]  Eric-Jan Wagenmakers,et al.  A Tutorial on Fisher Information , 2017, 1705.01064.

[26]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[27]  David J. Schwab,et al.  Supervised Learning with Quantum-Inspired Tensor Networks , 2016, ArXiv.

[28]  Anmer Daskin Quantum Principal Component Analysis , 2015 .

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.