$\zeta$-QVAE: A Quantum Variational Autoencoder utilizing Regularized Mixed-state Latent Representations

A major challenge in near-term quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves compressing the original data to manageable dimensions while still representing essential information for downstream analysis. In classical machine learning, variational autoencoders (VAEs) facilitate efficient data compression, representation learning for subsequent tasks, and novel data generation. However, no model has been proposed that exactly captures all of these features for direct application to quantum data on quantum computers. Some existing quantum models for data compression lack regularization of latent representations, thus preventing direct use for generation and control of generalization. Others are hybrid models with only some internal quantum components, impeding direct training on quantum data. To bridge this gap, we present a fully quantum framework, $\zeta$-QVAE, which encompasses all the capabilities of classical VAEs and can be directly applied for both classical and quantum data compression. Our model utilizes regularized mixed states to attain optimal latent representations. It accommodates various divergences for reconstruction and regularization. Furthermore, by accommodating mixed states at every stage, it can utilize the full-data density matrix and allow for a"global"training objective. Doing so, in turn, makes efficient optimization possible and has potential implications for private and federated learning. In addition to exploring the theoretical properties of $\zeta$-QVAE, we demonstrate its performance on representative genomics and synthetic data. Our results consistently indicate that $\zeta$-QVAE exhibits similar or better performance compared to matched classical models.

[1]  Patrick J. Coles,et al.  Representation Theory for Geometric Quantum Machine Learning , 2022, ArXiv.

[2]  C. Macchiavello,et al.  Quantum neural network autoencoder and classifier applied to an industrial case study , 2022, Quantum Machine Intelligence.

[3]  Pablo Rivas,et al.  Hybrid Quantum Variational Autoencoders for Representation Learning , 2021, 2021 International Conference on Computational Science and Computational Intelligence (CSCI).

[4]  M. Cerezo,et al.  Effect of barren plateaus on gradient-free optimization , 2020, Quantum.

[5]  Carlos Bravo-Prieto,et al.  Quantum autoencoders with enhanced data encoding , 2020, Mach. Learn. Sci. Technol..

[6]  Francesco Petruccione,et al.  A divide-and-conquer algorithm for quantum state preparation , 2020, Scientific Reports.

[7]  Pieter Abbeel,et al.  Denoising Diffusion Probabilistic Models , 2020, NeurIPS.

[8]  D. Dong,et al.  On compression rate of quantum autoencoders: Control design, numerical and experimental realization , 2020, Autom..

[9]  R. Kueng,et al.  Predicting many properties of a quantum system from very few measurements , 2020, Nature Physics.

[10]  S. Lloyd,et al.  Quantum embeddings for machine learning , 2020, 2001.03622.

[11]  Shouvanik Chakrabarti,et al.  Quantum Wasserstein Generative Adversarial Networks , 2019, NeurIPS.

[12]  Prashant S. Emani,et al.  Comprehensive functional genomic resource and integrative model for the human brain , 2018, Science.

[13]  Roger G. Melko,et al.  Reconstructing quantum states with generative models , 2018, Nature Machine Intelligence.

[14]  Walter Vinci,et al.  Quantum variational autoencoder , 2018, Quantum Science and Technology.

[15]  Bernhard Schölkopf,et al.  Wasserstein Auto-Encoders , 2017, ICLR.

[16]  Omar Fawzi,et al.  Efficient optimization of the quantum relative entropy , 2017, Journal of Physics A: Mathematical and Theoretical.

[17]  Matthias Troyer,et al.  Neural-network quantum state tomography , 2017, Nature Physics.

[18]  Alán Aspuru-Guzik,et al.  Quantum autoencoders for efficient compression of quantum data , 2016, 1612.02806.

[19]  Christopher Burgess,et al.  beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework , 2016, ICLR 2016.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[22]  D. Gross,et al.  Efficient quantum state tomography. , 2010, Nature communications.

[23]  P. W. Lamberti,et al.  Jensen-Shannon divergence as a measure of distinguishability between mixed quantum states , 2005, quant-ph/0508138.

[24]  V. Vedral The role of relative entropy in quantum information theory , 2001, quant-ph/0102094.

[25]  R. Jozsa Fidelity for Mixed Quantum States , 1994 .