Measurement-based adaptation protocol with quantum reinforcement learning

Machine learning employs dynamical algorithms that mimic the human capacity to learn, where the reinforcement learning ones are among the most similar to humans in this respect. On the other hand, adaptability is an essential aspect to perform any task efficiently in a changing environment, and it is fundamental for many purposes, such as natural selection. Here, we propose an algorithm based on successive measurements to adapt one quantum state to a reference unknown state, in the sense of achieving maximum overlap. The protocol naturally provides many identical copies of the reference state, such that in each measurement iteration more information about it is obtained. In our protocol, we consider a system composed of three parts, the "environment" system, which provides the reference state copies; the register, which is an auxiliary subsystem that interacts with the environment to acquire information from it; and the agent, which corresponds to the quantum state that is adapted by digital feedback with input corresponding to the outcome of the measurements on the register. With this proposal we can achieve an average fidelity between the environment and the agent of more than $90\% $ with less than $30$ iterations of the protocol. In addition, we extend the formalism to $ d $-dimensional states, reaching an average fidelity of around $80\% $ in less than $400$ iterations for $d=$ 11, for a variety of genuinely quantum as well as semiclassical states. This work paves the way for the development of quantum reinforcement learning protocols using quantum data, and the future deployment of semi-autonomous quantum systems.

[1]  M. L. Ladron de Guevara,et al.  Measurement-driven quantum evolution , 2006 .

[2]  Rupak Biswas,et al.  A NASA perspective on quantum computing: Opportunities and challenges , 2017, Parallel Comput..

[3]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[4]  Ashish Kapoor,et al.  Quantum algorithms for nearest-neighbor methods for supervised and unsupervised learning , 2014, Quantum Inf. Comput..

[5]  Mario Krenn,et al.  Active learning machine learns to create new quantum experiments , 2017, Proceedings of the National Academy of Sciences.

[6]  Alejandro Perdomo-Ortiz,et al.  Quantum-assisted Helmholtz machines: A quantum–classical deep learning framework for industrial datasets in near-term devices , 2017, ArXiv.

[7]  Erik Lucero,et al.  Synthesizing arbitrary quantum states in a superconducting resonator , 2009, Nature.

[8]  Gilles Brassard,et al.  Quantum speed-up for unsupervised learning , 2012, Machine Learning.

[9]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[10]  H. Neven,et al.  Digitized adiabatic quantum computing with a superconducting circuit. , 2015, Nature.

[11]  J. C. Retamal,et al.  Multiqubit and multilevel quantum reinforcement learning with quantum technologies , 2017, PloS one.

[13]  C. Weedbrook,et al.  Quantum Machine Learning over Infinite Dimensions. , 2016, Physical review letters.

[14]  L. DiCarlo,et al.  Demonstration of two-qubit algorithms with a superconducting quantum processor , 2009, Nature.

[15]  A. Harrow,et al.  Quantum algorithm for linear systems of equations. , 2008, Physical review letters.

[16]  Barry C. Sanders,et al.  Designing High-Fidelity Single-Shot Three-Qubit Gates: A Machine Learning Approach , 2015, ArXiv.

[17]  H. J. Briegel,et al.  Adaptive quantum computation in changing environments using projective simulation , 2014, Scientific Reports.

[18]  Pankaj Mehta,et al.  Reinforcement Learning in Different Phases of Quantum Control , 2017, Physical Review X.

[19]  W. Marsden I and J , 2012 .

[20]  Matthias Troyer,et al.  Neural-network quantum state tomography , 2018 .

[21]  Enrique Solano,et al.  Supervised Quantum Learning without Measurements , 2017, Scientific Reports.

[22]  J. Gambetta,et al.  Superconducting qubit in a waveguide cavity with a coherence time approaching 0.1 ms , 2012, 1202.5533.

[23]  Rupak Biswas,et al.  Quantum-Assisted Learning of Hardware-Embedded Probabilistic Graphical Models , 2016, 1609.02542.

[24]  Hans-J. Briegel,et al.  Quantum-enhanced machine learning , 2016, Physical review letters.

[25]  Michael L. Littman,et al.  Reinforcement learning improves behaviour from evaluative feedback , 2015, Nature.

[26]  Erik Lucero,et al.  Generation of Fock states in a superconducting quantum circuit , 2008, Nature.

[27]  Lucas Lamata,et al.  Basic protocols in quantum reinforcement learning with superconducting circuits , 2017, Scientific Reports.

[28]  Hans-J. Briegel,et al.  Machine learning \& artificial intelligence in the quantum domain , 2017, ArXiv.

[29]  Hans-J. Briegel,et al.  Projective simulation with generalization , 2015, Scientific Reports.

[30]  Hans J. Briegel,et al.  Projective simulation for artificial intelligence , 2011, Scientific Reports.

[31]  V. Scarani,et al.  Quantum cloning , 2005, quant-ph/0511088.

[32]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[33]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[34]  Seth Lloyd,et al.  Quantum algorithm for data fitting. , 2012, Physical review letters.

[35]  Frederick W. Strauch,et al.  Quantum logic gates for superconducting resonator qudits , 2011, 1108.2984.

[36]  L. Lamata,et al.  Measurement-based adaptation protocol with quantum reinforcement learning in a Rigetti quantum computer , 2018 .

[37]  L. DiCarlo,et al.  Initialization by measurement of a superconducting quantum bit circuit. , 2012, Physical review letters.

[38]  Akio Tojo,et al.  Fingerprint pattern classification , 1984, Pattern Recognit..

[39]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[40]  Anna Levit,et al.  Reinforcement learning using quantum Boltzmann machines , 2016, Quantum Inf. Comput..

[41]  V. I. Man'ko,et al.  Multilevel superconducting circuits as two-qubit systems: Operations, state preparation, and entropic inequalities , 2015 .

[42]  Vedran Dunjko,et al.  Quantum speedup for active learning agents , 2014, 1401.4997.

[43]  Aephraim M. Steinberg,et al.  Improving quantum state estimation with mutually unbiased bases. , 2008, Physical review letters.

[44]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[45]  Thierry Paul,et al.  Quantum computation and quantum information , 2007, Mathematical Structures in Computer Science.

[46]  Klaus Molmer,et al.  Qudit quantum computation in the Jaynes-Cummings model , 2012, 1210.4488.

[47]  Anil K. Jain Technology: Biometric recognition , 2007, Nature.

[48]  S. Girvin,et al.  Cavity quantum electrodynamics for superconducting electrical circuits: An architecture for quantum computation , 2004, cond-mat/0402216.

[49]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[50]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[51]  C. C. Bultink,et al.  Feedback control of a solid-state qubit using high-fidelity projective measurement. , 2012, Physical review letters.

[52]  Hans-J. Briegel,et al.  Projective Simulation for Classical Learning Agents: A Comprehensive Investigation , 2015, New Generation Computing.

[53]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[54]  Matthew Day,et al.  Advances in quantum machine learning , 2015, 1512.02900.

[55]  S. Lloyd,et al.  Quantum algorithms for supervised and unsupervised machine learning , 2013, 1307.0411.

[56]  Anmer Daskin Quantum Principal Component Analysis , 2015 .

[57]  Masahide Sasaki,et al.  Quantum learning and universal quantum matching machine , 2002 .

[58]  F. Petruccione,et al.  An introduction to quantum machine learning , 2014, Contemporary Physics.

[59]  P. Baldi,et al.  Searching for exotic particles in high-energy physics with deep learning , 2014, Nature Communications.

[60]  Amir Kalev,et al.  Experimental Study of Optimal Measurements for Quantum State Tomography. , 2017, Physical review letters.

[61]  Rupak Biswas,et al.  Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers , 2017, Quantum Science and Technology.

[62]  Zahir Tari,et al.  A Survey of Clustering Algorithms for Big Data: Taxonomy and Empirical Analysis , 2014, IEEE Transactions on Emerging Topics in Computing.

[63]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[64]  S. Girvin,et al.  Observation of high coherence in Josephson junction qubits measured in a three-dimensional circuit QED architecture. , 2011, Physical review letters.

[65]  R. Schoelkopf,et al.  Superconducting Circuits for Quantum Information: An Outlook , 2013, Science.

[66]  Barry C Sanders,et al.  High-Fidelity Single-Shot Toffoli Gate via Quantum Control. , 2015, Physical review letters.

[67]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.