Transfer learning in hybrid classical-quantum neural networks

We extend the concept of transfer learning, widely applied in modern machine learning algorithms, to the emerging context of hybrid neural networks composed of classical and quantum elements. We propose different implementations of hybrid transfer learning, but we focus mainly on the paradigm in which a pre-trained classical network is modified and augmented by a final variational quantum circuit. This approach is particularly attractive in the current era of intermediate-scale quantum technology since it allows to optimally pre-process high dimensional data (e.g., images) with any state-of-the-art classical network and to embed a select set of highly informative features into a quantum processor. We present several proof-of-concept examples of the convenient application of quantum transfer learning for image recognition and quantum state classification. We use the cross-platform software library PennyLane to experimentally test a high-resolution image classifier with two different quantum computers, respectively provided by IBM and Rigetti.

[1]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[2]  Sebastian Ruder,et al.  Universal Language Model Fine-tuning for Text Classification , 2018, ACL.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .

[5]  知秀 柴田.  5分で分かる!? 有名論文ナナメ読み：Jacob Devlin et al. : BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding , 2020 .

[6]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[9]  Peter Wittek,et al.  Adversarial Domain Adaptation for Identifying Phase Transitions , 2017, ArXiv.

[10]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[11]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[12]  Peter D. Johnson,et al.  Expressibility and Entangling Capability of Parameterized Quantum Circuits for Hybrid Quantum‐Classical Algorithms , 2019, Advanced Quantum Technologies.

[13]  Alejandro Perdomo-Ortiz,et al.  Quantum-assisted Helmholtz machines: A quantum–classical deep learning framework for industrial datasets in near-term devices , 2017, ArXiv.

[14]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[15]  Aida Todri,et al.  Enabling multi-programming mechanism for quantum computing in the NISQ era , 2021, ArXiv.

[16]  Rupak Biswas,et al.  Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers , 2017, Quantum Science and Technology.

[17]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[18]  Gang Su,et al.  Machine learning by unitary tensor network of hierarchical tree structure , 2017, New Journal of Physics.

[19]  Kodai Shiba,et al.  Convolution filter embedded quantum gate autoencoder , 2019, ArXiv.

[20]  Aram W. Harrow,et al.  Quantum computational supremacy , 2017, Nature.

[21]  Seth Lloyd,et al.  Gaussian quantum information , 2011, 1110.3234.

[22]  N. Killoran,et al.  Strawberry Fields: A Software Platform for Photonic Quantum Computing , 2018, Quantum.

[23]  Simone Severini,et al.  Image classification with quantum pre-training and auto-encoders , 2018 .

[24]  Travis S. Humble,et al.  Quantum supremacy using a programmable superconducting processor , 2019, Nature.

[25]  F. Petruccione,et al.  An introduction to quantum machine learning , 2014, Contemporary Physics.

[26]  Debanjan Bhowmik,et al.  Supervised learning with a quantum classifier using multi-level systems , 2019, Quantum Inf. Process..

[27]  Nathan Killoran,et al.  PennyLane: Automatic differentiation of hybrid quantum-classical computations , 2018, ArXiv.

[28]  Dario Poletti,et al.  Transfer learning for scalability of neural-network quantum states. , 2019, Physical review. E.

[29]  R. Melko,et al.  Machine Learning Phases of Strongly Correlated Fermions , 2016, Physical Review X.

[30]  William J. Zeng,et al.  A Practical Quantum Instruction Set Architecture , 2016, ArXiv.

[31]  Lorien Y. Pratt,et al.  Discriminability-Based Transfer between Neural Networks , 1992, NIPS.

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Maria Schuld,et al.  Quantum Machine Learning in Feature Hilbert Spaces. , 2018, Physical review letters.

[34]  Seth Lloyd,et al.  Continuous-variable quantum neural networks , 2018, Physical Review Research.

[35]  M. Schuld,et al.  Circuit-centric quantum classifiers , 2018, Physical Review A.

[36]  Hartmut Neven,et al.  Classification with Quantum Neural Networks on Near Term Processors , 2018, 1802.06002.

[37]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[38]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Hans-J. Briegel,et al.  Quantum-enhanced machine learning , 2016, Physical review letters.

[40]  Ievgeniia Oshurko.  Quantum Machine Learning , 2020, Quantum Computing.

[41]  Ryan Babbush,et al.  The theory of variational hybrid quantum-classical algorithms , 2015, 1509.04279.

[42]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[43]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[44]  Alán Aspuru-Guzik,et al.  A variational eigenvalue solver on a photonic quantum processor , 2013, Nature Communications.

[45]  Maxwell Henderson,et al.  Quanvolutional neural networks: powering image recognition with quantum circuits , 2019, Quantum Machine Intelligence.

[46]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Masoud Mohseni,et al.  Learning to learn with quantum neural networks via classical neural networks , 2019, ArXiv.

[49]  John Preskill,et al.  Quantum Computing in the NISQ era and beyond , 2018, Quantum.

[50]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[51]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[52]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .