Learning and Inference in Hilbert Space with Quantum Graphical Models

Quantum Graphical Models (QGMs) generalize classical graphical models by adopting the formalism for reasoning about uncertainty from quantum mechanics. Unlike classical graphical models, QGMs represent uncertainty with density matrices in complex Hilbert spaces. Hilbert space embeddings (HSEs) also generalize Bayesian inference in Hilbert spaces. We investigate the link between QGMs and HSEs and show that the sum rule and Bayes rule for QGMs are equivalent to the kernel sum rule in HSEs and a special case of Nadaraya-Watson kernel regression, respectively. We show that these operations can be kernelized, and use these insights to propose a Hilbert Space Embedding of Hidden Quantum Markov Models (HSE-HQMM) to model dynamics. We present experimental results showing that HSE-HQMMs are competitive with state-of-the-art models like LSTMs and PSRNNs on several datasets, while also providing a nonparametric method for maintaining a probability distribution over continuous-valued features.

[1]  Byron Boots,et al.  Learning Hidden Quantum Markov Models , 2017, AISTATS.

[2]  Byron Boots,et al.  Hilbert Space Embeddings of Predictive State Representations , 2013, UAI.

[3]  Thierry Paul,et al.  Quantum computation and quantum information , 2007, Mathematical Structures in Computer Science.

[4]  Le Song,et al.  A unified kernel framework for nonparametric inference in graphical models ] Kernel Embeddings of Conditional Distributions , 2013 .

[5]  Chen-Hsiang Yeang,et al.  A Probabilistic Graphical Model of Quantum Systems , 2010, 2010 Ninth International Conference on Machine Learning and Applications.

[6]  E. Nadaraya.  On Estimating Regression , 1964 .

[7]  Le Song,et al.  Hilbert Space Embeddings of Hidden Markov Models , 2010, ICML.

[8]  Alexander J. Smola,et al.  Hilbert space embeddings of conditional distributions with applications to dynamical systems , 2009, ICML '09.

[9]  Byron Boots,et al.  Predictive State Recurrent Neural Networks , 2017, NIPS.

[10]  Byron Boots,et al.  Hilbert Space Embeddings of PSRs , 2012 .

[11]  K. Wiesner,et al.  Hidden Quantum Markov Models and non-adaptive read-out of many-body states , 2010, 1002.2337.

[12]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[13]  Geoffrey J. Gordon,et al.  Supervised Learning for Dynamical System Learning , 2015, NIPS.

[14]  Benjamin Recht,et al.  Random Features for Large-Scale Kernel Machines , 2007, NIPS.

[15]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[16]  Le Song,et al.  A Hilbert Space Embedding for Distributions , 2007, Discovery Science.

[17]  D. Poulin,et al.  Quantum Graphical Models and Belief Propagation , 2007, 0708.1337.

[18]  Maria Schuld,et al.  Quantum Machine Learning in Feature Hilbert Spaces. , 2018, Physical review letters.

[19]  Larry Wasserman,et al.  All of Nonparametric Statistics (Springer Texts in Statistics) , 2006 .