Temporal Information Processing on Noisy Quantum Computers

The combination of machine learning and quantum computing has emerged as a promising approach for addressing previously untenable problems. Reservoir computing is an efficient learning paradigm that utilizes nonlinear dynamical systems for temporal information processing, i.e., processing of input sequences to produce output sequences. Here we propose quantum reservoir computing that harnesses complex dissipative quantum dynamics. Our class of quantum reservoirs is universal, in that any nonlinear fading memory map can be approximated arbitrarily closely and uniformly over all inputs by a quantum reservoir from this class. We describe a subclass of the universal class that is readily implementable using quantum gates native to current noisy gate-model quantum computers. Proof-of-principle experiments on remotely accessed cloud-based superconducting quantum computers demonstrate that small and noisy quantum reservoirs can tackle high-order nonlinear temporal tasks. Our theoretical and experimental results pave the path for attractive temporal processing applications of near-term gate-model quantum computers of increasing fidelity but without quantum error correction, signifying the potential of these devices for wider applications including neural modeling, speech recognition and natural language processing, going beyond static classification and regression tasks.

[1]  Moritz Hardt,et al.  Stable Recurrent Models , 2018, ICLR.

[2]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[3]  Ievgeniia Oshurko Quantum Machine Learning , 2020, Quantum Computing.

[4]  B. Irie,et al.  Capabilities of three-layered perceptrons , 1988, IEEE 1988 International Conference on Neural Networks.

[5]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[6]  Benjamin Schrauwen,et al.  Information Processing Capacity of Dynamical Systems , 2012, Scientific Reports.

[7]  Leon O. Chua,et al.  Fading memory and the problem of approximating nonlinear operators with volterra series , 1985 .

[8]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[9]  D. Petz,et al.  Contractivity of positive and trace-preserving maps under Lp norms , 2006, math-ph/0601063.

[10]  Laurent Larger,et al.  High-Speed Photonic Reservoir Computing Using a Time-Delay-Based Architecture: Million Words per Second Classification , 2017 .

[11]  Kristan Temme,et al.  Supervised learning with quantum-enhanced feature spaces , 2018, Nature.

[12]  J. Gambetta,et al.  Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets , 2017, Nature.

[13]  Serge Massar,et al.  High performance photonic reservoir computer based on a coherently driven passive cavity , 2015, ArXiv.

[14]  Juan-Pablo Ortega,et al.  Universal discrete-time reservoir computers with stochastic inputs and linear readouts using non-homogeneous state-affine systems , 2017, J. Mach. Learn. Res..

[15]  Kohei Nakajima,et al.  Machine learning with controllable quantum dynamics of a nuclear spin ensemble in a solid , 2018, 1806.10910.

[16]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[17]  Jiayin Chen,et al.  Learning nonlinear input–output maps with dissipative quantum systems , 2019, Quantum Information Processing.

[18]  Henk B. Verbruggen,et al.  A new method for identification and control of nonlinear dynamic systems , 1996 .

[19]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[20]  Jiayin Chen,et al.  Towards Single-Input Single-Output Nonlinear System Identification and Signal Processing on Near-Term Quantum Computers , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[21]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[22]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[23]  Simone Severini,et al.  Quantum machine learning: a classical perspective , 2017, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[24]  Jiayin Chen,et al.  Correction to: Learning nonlinear input-output maps with dissipative quantum systems , 2019, Quantum Inf. Process..

[25]  Toshiyuki Yamane,et al.  Recent Advances in Physical Reservoir Computing: A Review , 2018, Neural Networks.

[26]  Seung Hwan Lee,et al.  Reservoir computing using dynamic memristors for temporal information processing , 2017, Nature Communications.

[27]  Damien Querlioz,et al.  Neuromorphic computing with nanoscale spintronic oscillators , 2017, Nature.

[28]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[29]  Ying Li,et al.  Efficient Variational Quantum Simulator Incorporating Active Error Minimization , 2016, 1611.09301.

[30]  Kohei Nakajima,et al.  Physical reservoir computing—an introductory perspective , 2020, Japanese Journal of Applied Physics.

[31]  Geert Morthier,et al.  Experimental demonstration of reservoir computing on a silicon photonics chip , 2014, Nature Communications.

[32]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[33]  S. Lang Complex Analysis , 1977 .

[34]  Keisuke Fujii,et al.  Boosting Computational Power through Spatial Multiplexing in Quantum Reservoir Computing , 2018, Physical Review Applied.

[35]  Juan-Pablo Ortega,et al.  Echo state networks are universal , 2018, Neural Networks.

[36]  Maxim Raginsky,et al.  Universal Approximation of Input-Output Maps by Temporal Convolutional Nets , 2019, NeurIPS.

[37]  Andrew W. Cross,et al.  Open Quantum Assembly Language , 2017, 1707.03429.

[38]  Keisuke Fujii,et al.  Harnessing disordered quantum dynamics for machine learning , 2016, 1602.08159.

[39]  John Preskill,et al.  Quantum Computing in the NISQ era and beyond , 2018, Quantum.

[40]  Kristan Temme,et al.  Error mitigation extends the computational reach of a noisy quantum processor , 2019, Nature.

[41]  J. Gambetta,et al.  Error mitigation extends the computational reach of a noisy quantum processor , 2018, Nature.