Speeding-up the decision making of a learning agent using an ion trap quantum processor

We report a proof-of-principle experimental demonstration of the quantum speed-up for learning agents utilizing a small-scale quantum information processor based on radiofrequency-driven trapped ions. The decision-making process of a quantum learning agent within the projective simulation paradigm for machine learning is implemented in a system of two qubits. The latter are realized using hyperfine states of two frequency-addressed atomic ions exposed to a static magnetic field gradient. We show that the deliberation time of this quantum learning agent is quadratically improved with respect to comparable classical learning agents. The performance of this quantum-enhanced learning agent highlights the potential of scalable quantum processors taking advantage of machine learning.

[1]  A. Varon,et al.  A trapped-ion-based quantum byte with 10−5 next-neighbour cross-talk , 2014, Nature Communications.

[2]  Christof Wunderlich,et al.  Ion-trajectory analysis for micromotion minimization and the measurement of small forces , 2015, 1503.07031.

[3]  Enrique Solano,et al.  Supervised Quantum Learning without Measurements , 2017, Scientific Reports.

[4]  C-Y Lu,et al.  Entanglement-based machine learning on a quantum computer. , 2015, Physical review letters.

[5]  Mario Krenn,et al.  Active learning machine learns to create new quantum experiments , 2017, Proceedings of the National Academy of Sciences.

[6]  Thomas Halfmann,et al.  Arbitrarily Accurate Pulse Sequences for Robust Dynamical Decoupling. , 2016, Physical review letters.

[7]  J. P. Home,et al.  Realization of a programmable two-qubit quantum processor , 2009, 0908.3031.

[8]  Thierry Paul,et al.  Quantum computation and quantum information , 2007, Mathematical Structures in Computer Science.

[9]  Hyeran Byun,et al.  Real-time traffic sign recognition based on a general purpose GPU and deep-learning , 2017, PloS one.

[10]  Justus H. Piater,et al.  Robotic playing for hierarchical complex skill learning , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Peter W. Shor,et al.  Algorithms for quantum computation: discrete logarithms and factoring , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[12]  Hans-J. Briegel,et al.  Machine learning \& artificial intelligence in the quantum domain , 2017, ArXiv.

[13]  Hans-J. Briegel,et al.  Projective simulation with generalization , 2015, Scientific Reports.

[14]  Hans-J. Briegel,et al.  Projective simulation applied to the grid-world and the mountain-car problem , 2014, Artif. Intell. Res..

[15]  Hans J. Briegel,et al.  Projective simulation for artificial intelligence , 2011, Scientific Reports.

[16]  L. DiCarlo,et al.  Demonstration of two-qubit algorithms with a superconducting quantum processor , 2009, Nature.

[17]  P. C. Haljan,et al.  Implementation of Grover's quantum search algorithm in a scalable system , 2005 .

[18]  Hans-J. Briegel,et al.  Quantum-enhanced machine learning , 2016, Physical review letters.

[19]  C. Monroe,et al.  Large-scale modular quantum-computer architecture with atomic memory and photonic interconnects , 2012, 1208.0391.

[20]  Christof Wunderlich,et al.  Versatile microwave-driven trapped ion spin system for quantum information processing , 2015, Science Advances.

[21]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[22]  Vedran Dunjko,et al.  Quantum speedup for active learning agents , 2014, 1401.4997.

[23]  M. Szegedy,et al.  Quantum Walk Based Search Algorithms , 2008, TAMC.

[24]  P. C. Haljan,et al.  Entanglement of trapped-ion clock states , 2005 .

[25]  David Von Dollen,et al.  Quantum-Enhanced Reinforcement Learning for Finite-Episode Games with Discrete State Spaces , 2017, Front. Phys..

[26]  S. Lloyd,et al.  Quantum-Enhanced Measurements: Beating the Standard Quantum Limit , 2004, Science.

[27]  Yi-Kai Liu,et al.  Super-polynomial and exponential improvements for quantum-enhanced reinforcement learning , 2017 .

[28]  H. J. Briegel,et al.  Adaptive quantum computation in changing environments using projective simulation , 2014, Scientific Reports.

[29]  Jiangfeng Du,et al.  Experimental realization of a quantum support vector machine. , 2015, Physical review letters.

[30]  Ievgeniia Oshurko.  Quantum Machine Learning , 2020, Quantum Computing.

[31]  Jonathan Schaeffer,et al.  Checkers Is Solved , 2007, Science.

[32]  Pavel Sekatski,et al.  Flexible resources for quantum metrology , 2016, 1610.09999.

[33]  Christof Wunderlich,et al.  Radio frequency sideband cooling and sympathetic cooling of trapped ions in a static magnetic field gradient , 2017, 1710.09241.

[34]  Hans-J. Briegel,et al.  Projective Simulation for Classical Learning Agents: A Comprehensive Investigation , 2015, New Generation Computing.

[35]  J. P. Home,et al.  Normal modes of trapped ions in the presence of anharmonic trap potentials , 2011, 1105.4752.

[36]  Nikolay V. Vitanov,et al.  Fault-tolerant Hahn-Ramsey interferometry with pulse sequences of alternating detuning , 2015 .

[37]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[38]  Andrew W. Cross,et al.  Demonstration of quantum advantage in machine learning , 2015, npj Quantum Information.

[39]  Hans-J. Briegel,et al.  Meta-learning within Projective Simulation , 2016, IEEE Access.

[40]  Lov K. Grover.  A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[41]  Nicolai Friis,et al.  Coherent controlization using superconducting qubits , 2015, Scientific Reports.

[42]  M. Johanning,et al.  Designer spin pseudomolecule implemented with trapped ions in a magnetic gradient. , 2011, Physical review letters.

[43]  V. Dunjko,et al.  Implementing quantum control for unknown subroutines , 2014, 1401.8128.

[44]  Sabine Wolk,et al.  State selective detection of hyperfine qubits , 2014, 1406.5821.

[45]  Simon J. Devitt,et al.  Blueprint for a microwave trapped ion quantum computer , 2015, Science Advances.

[46]  T. Monz,et al.  Realization of a scalable Shor algorithm , 2015, Science.

[47]  S. Debnath,et al.  Demonstration of a small programmable quantum computer with atomic qubits , 2016, Nature.

[48]  C. Monroe,et al.  Architecture for a large-scale ion-trap quantum computer , 2002, Nature.

[49]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[50]  Dmitri Maslov,et al.  Complete 3-Qubit Grover search on a programmable quantum computer , 2017, Nature Communications.