A reinforcement learning approach for quantum state engineering

Machine learning (ML) has become an attractive tool for solving various problems in different fields of physics, including the quantum domain. Here, we show how classical reinforcement learning (RL) could be used as a tool for quantum state engineering (QSE). We employ a measurement based control for QSE where the action sequences are determined by the choice of the measurement basis and the reward through the fidelity of obtaining the target state. Our analysis clearly displays a learning feature in QSE, for example in preparing arbitrary two-qubit entangled states and delivers successful action sequences that generalise previously found human solutions from exact quantum dynamics. We provide a systematic algorithmic approach for using RL for quantum protocols that deal with a non-trivial continuous state space, and discuss the scaling of these approaches for the preparation of larger entangled (cluster) states.

[1]  Mario Krenn,et al.  Active learning machine learns to create new quantum experiments , 2017, Proceedings of the National Academy of Sciences.

[2]  Matthias Troyer,et al.  Neural-network quantum state tomography , 2018 .

[3]  David J. Schwab,et al.  A high-bias, low-variance introduction to Machine Learning for physicists , 2018, Physics reports.

[4]  Guillaume Lample,et al.  Phrase-Based & Neural Unsupervised Machine Translation , 2018, EMNLP.

[5]  Quoc V. Le,et al.  Large-Scale Evolution of Image Classifiers , 2017, ICML.

[6]  Johannes N. Greiner,et al.  Purification of an unpolarized spin ensemble into entangled singlet pairs , 2016, Scientific Reports.

[7]  Tzyh Jong Tarn,et al.  Fidelity-Based Probabilistic Q-Learning for Control of Quantum Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[9]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[10]  Neil B. Manson,et al.  The nitrogen-vacancy colour centre in diamond , 2013, 1302.3288.

[11]  Nicolai Friis,et al.  Optimizing Quantum Error Correction Codes with Reinforcement Learning , 2018, Quantum.

[12]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Joel Johansson,et al.  Quantum error correction for the toric code using deep reinforcement learning , 2018, Quantum.

[15]  Peter Stone,et al.  Deep Recurrent Q-Learning for Partially Observable MDPs , 2015, AAAI Fall Symposia.

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[17]  B. Hensen,et al.  High-fidelity projective read-out of a solid-state spin quantum register , 2011, Nature.

[18]  Florian Marquardt,et al.  Reinforcement Learning with Neural Networks for Quantum Feedback , 2018, Physical Review X.

[19]  Alexander Alodjants,et al.  Predicting quantum advantage by quantum walk with convolutional neural networks , 2019, New Journal of Physics.

[20]  Marin Bukov,et al.  Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator , 2018, Physical Review B.

[21]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[22]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[23]  Amit Finkler,et al.  Single spin magnetic resonance. , 2016, Journal of magnetic resonance.

[24]  Hans J. Briegel,et al.  Projective simulation for artificial intelligence , 2011, Scientific Reports.

[25]  Hartmut Neven,et al.  Universal quantum control through deep reinforcement learning , 2019 .

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  J. Wrachtrup,et al.  Observation of nonclassical measurement statistics induced by a coherent spin environment , 2018, Physical Review A.

[28]  Jens Eisert,et al.  Reinforcement learning decoders for fault-tolerant quantum computation , 2018, Mach. Learn. Sci. Technol..

[29]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[30]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[31]  Dario Tamascelli,et al.  Coherent transport of quantum states by deep reinforcement learning , 2019, Communications Physics.

[32]  Yu Cai,et al.  A neural network oracle for quantum nonlocality problems in networks , 2019, npj Quantum Information.

[33]  Pankaj Mehta,et al.  Reinforcement Learning in Different Phases of Quantum Control , 2017, Physical Review X.