Differentiable Quantum Architecture Search

Quantum architecture search (QAS) is the process of automating architecture engineering of quantum circuits. It has been desired to construct a powerful and general QAS platform which can significantly accelerate current efforts to identify quantum advantages of error-prone and depth-limited quantum circuits in the NISQ era. Hereby, we propose a general framework of differentiable quantum architecture search (DQAS), which enables automated designs of quantum circuits in an end-to-end differentiable fashion. We present several examples of circuit design problems to demonstrate the power of DQAS. For instance, unitary operations are decomposed into quantum gates, noisy circuits are re-designed to improve accuracy, and circuit layouts for quantum approximation optimization algorithm are automatically discovered and upgraded for combinatorial optimization problems. These results not only manifest the vast potential of DQAS being an essential tool for the NISQ application developments, but also present an interesting research topic from the theoretical perspective as it draws inspirations from the newly emerging interdisciplinary paradigms of differentiable programming, probabilistic programming, and quantum programming.

[1]  Florian Marquardt,et al.  Reinforcement Learning with Neural Networks for Quantum Feedback , 2018, Physical Review X.

[2]  John Preskill,et al.  Quantum Computing in the NISQ era and beyond , 2018, Quantum.

[3]  Giacomo Nannicini,et al.  Improving Variational Quantum Optimization using CVaR , 2019, Quantum.

[4]  Ramesh Raskar,et al.  Designing Neural Network Architectures using Reinforcement Learning , 2016, ICLR.

[5]  David Gamarnik,et al.  The Quantum Approximate Optimization Algorithm Needs to See the Whole Graph: A Typical Case , 2020, ArXiv.

[6]  Li Yang,et al.  Big Bird: Transformers for Longer Sequences , 2020, NeurIPS.

[7]  Ryan Babbush,et al.  Barren plateaus in quantum neural network training landscapes , 2018, Nature Communications.

[8]  Alexandru Gheorghiu,et al.  A deep learning model for noise prediction on near-term quantum devices , 2020, 2005.10811.

[9]  Amnon Shashua,et al.  Deep autoregressive models for the efficient variational simulation of many-body quantum systems , 2019, Physical review letters.

[10]  Nathan Wiebe,et al.  Hamiltonian simulation using linear combinations of unitary operations , 2012, Quantum Inf. Comput..

[11]  Jack P. C. Kleijnen,et al.  Optimization and Sensitivity Analysis of Computer Simulation Models by the Score Function Method , 1996 .

[12]  Alan L. Yuille,et al.  Genetic CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Risto Miikkulainen,et al.  Designing neural networks through neuroevolution , 2019, Nat. Mach. Intell..

[14]  Michael Figurnov,et al.  Monte Carlo Gradient Estimation in Machine Learning , 2019, J. Mach. Learn. Res..

[15]  Gaofeng Meng,et al.  DATA: Differentiable ArchiTecture Approximation , 2019, NeurIPS.

[16]  Yong Yu,et al.  Efficient Architecture Search by Network Transformation , 2017, AAAI.

[17]  Isabelle Guyon,et al.  Taking Human out of Learning Applications: A Survey on Automated Machine Learning , 2018, 1810.13306.

[18]  Hartmut Neven,et al.  Universal quantum control through deep reinforcement learning , 2018, npj Quantum Information.

[19]  E. Farhi,et al.  A Quantum Approximate Optimization Algorithm , 2014, 1411.4028.

[20]  Lei Wang,et al.  Solving quantum statistical mechanics with variational autoregressive networks and quantum circuits , 2019, Mach. Learn. Sci. Technol..

[21]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[22]  T. Albash.  Role of nonstoquastic catalysts in quantum adiabatic optimization , 2018, Physical Review A.

[23]  Yi Yang,et al.  Searching for a Robust Neural Architecture in Four GPU Hours , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Liang Lin,et al.  SNAS: Stochastic Neural Architecture Search , 2018, ICLR.

[25]  Patrick Riley,et al.  Quantum Optimization with a Novel Gibbs Objective Function and Ansatz Architecture Search , 2019 .

[26]  Oriol Vinyals,et al.  Hierarchical Representations for Efficient Architecture Search , 2017, ICLR.

[27]  Zhanxing Zhu,et al.  Efficient Neural Architecture Search via Proximal Iterations , 2020, AAAI.

[28]  Chunxiao Liu,et al.  DSNAS: Direct Neural Architecture Search Without Parameter Retraining , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Thomas Brox,et al.  Understanding and Robustifying Differentiable Architecture Search , 2020, ICLR.

[30]  A. Polkovnikov,et al.  Minimizing irreversible losses in quantum systems by local counterdiabatic driving , 2016, Proceedings of the National Academy of Sciences.

[31]  Gregory D. Hager,et al.  sharpDARTS: Faster and More Accurate Differentiable Architecture Search , 2019, ArXiv.

[32]  Joel J. Wallman,et al.  Noise tailoring for scalable quantum computation via randomized compiling , 2015, 1512.01098.

[33]  Shifeng Zhang,et al.  DARTS+: Improved Differentiable Architecture Search with Early Stopping , 2019, ArXiv.

[34]  Arman Cohan,et al.  Longformer: The Long-Document Transformer , 2020, ArXiv.

[35]  M. Benedetti,et al.  Quantum circuit structure learning , 2019, 1905.09692.

[36]  Seth Lloyd,et al.  Learning Unitaries by Gradient Descent , 2020, ArXiv.

[37]  Alán Aspuru-Guzik,et al.  A variational eigenvalue solver on a photonic quantum processor , 2013, Nature Communications.

[38]  Zhihui Li,et al.  A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions , 2020, ArXiv.

[39]  M Sanz,et al.  Genetic Algorithms for Digital Quantum Simulations. , 2015, Physical review letters.

[40]  Andreas Hartmann,et al.  Rapid counter-diabatic sweeps in lattice gauge adiabatic quantum computing , 2018, New Journal of Physics.

[41]  Bernard Ghanem,et al.  SGAS: Sequential Greedy Architecture Search , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[43]  Patrick J. Coles,et al.  Learning the quantum algorithm for state overlap , 2018, New Journal of Physics.

[44]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[45]  Soonwon Choi,et al.  Quantum convolutional neural networks , 2018, Nature Physics.

[46]  V. Ulyantsev,et al.  MoG-VQE: Multiobjective genetic variational quantum eigensolver , 2020, 2007.04424.

[47]  V. Akshay,et al.  Reachability Deficits in Quantum Approximate Optimization , 2019, Physical review letters.

[48]  Gavin E. Crooks,et al.  Gradients of parameterized quantum gates using the parameter-shift rule and gate decomposition , 2019, 1905.13311.

[49]  John Napp,et al.  Low-Depth Gradient Measurements Can Improve Convergence in Variational Hybrid Quantum-Classical Algorithms. , 2019, Physical review letters.

[50]  Xiangning Chen,et al.  Stabilizing Differentiable Architecture Search via Perturbation-based Regularization , 2020, ICML.

[51]  Alán Aspuru-Guzik,et al.  Quantum computational chemistry , 2018, Reviews of Modern Physics.

[52]  Urovs Kalabi'c,et al.  Application of Pontryagin's minimum principle to Grover's quantum search problem , 2019, Physical Review A.

[53]  Hartmut Neven,et al.  Classification with Quantum Neural Networks on Near Term Processors , 2018, 1802.06002.

[54]  Harper R. Grimsley,et al.  An adaptive variational algorithm for exact molecular simulations on a quantum computer , 2018, Nature Communications.

[55]  Patrick J. Coles,et al.  Machine learning of noise-resilient quantum circuits , 2020 .

[56]  Yiming Yang,et al.  DARTS: Differentiable Architecture Search , 2018, ICLR.

[57]  Quoc V. Le,et al.  Large-Scale Evolution of Image Classifiers , 2017, ICML.

[58]  Marcello Benedetti,et al.  Parameterized quantum circuits as machine learning models , 2019, Quantum Science and Technology.

[59]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[60]  F. Brandão,et al.  For Fixed Control Parameters the Quantum Approximate Optimization Algorithm's Objective Function Value Concentrates for Typical Instances , 2018, 1812.04170.

[61]  Alán Aspuru-Guzik,et al.  The theory of variational hybrid quantum-classical algorithms , 2015, 1509.04279.

[62]  Alok Aggarwal,et al.  Regularized Evolution for Image Classifier Architecture Search , 2018, AAAI.

[63]  Alejandro Perdomo-Ortiz,et al.  A generative modeling approach for benchmarking and training shallow quantum circuits , 2018, npj Quantum Information.

[64]  Jack Hidary,et al.  Quantum Hamiltonian-Based Models and the Variational Quantum Thermalizer Algorithm , 2019, ArXiv.

[65]  Hugo Larochelle,et al.  MADE: Masked Autoencoder for Distribution Estimation , 2015, ICML.

[66]  Lei Wang,et al.  Solving Statistical Mechanics using Variational Autoregressive Networks , 2018, Physical review letters.

[67]  Xiaopeng Zhang,et al.  PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search , 2020, ICLR.

[68]  Cedric Yen-Yu Lin,et al.  Different Strategies for Optimization Using the Quantum Adiabatic Algorithm , 2014, 1401.7320.

[69]  Kalyanmoy Deb,et al.  NSGA-Net: neural architecture search using multi-objective genetic algorithm , 2018, GECCO.

[70]  Qi Tian,et al.  Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and Evaluation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[71]  Leo Zhou,et al.  Quantum Approximate Optimization Algorithm: Performance, Mechanism, and Implementation on Near-Term Devices , 2018, Physical Review X.

[72]  L. Lamata,et al.  Approximate Quantum Adders with Genetic Algorithms: An IBM Quantum Experience , 2016, 1611.07851.

[73]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[74]  Rupak Biswas,et al.  From the Quantum Approximate Optimization Algorithm to a Quantum Alternating Operator Ansatz , 2017, Algorithms.

[75]  Hong Yao,et al.  Automatic Differentiable Monte Carlo: Theory and Application , 2019, ArXiv.

[76]  Hartmut Neven,et al.  Optimizing Variational Quantum Algorithms using Pontryagin's Minimum Principle , 2016, ArXiv.

[77]  Jonathan Gordon,et al.  Probabilistic Neural Architecture Search , 2019, ArXiv.

[78]  Shimon Whiteson,et al.  DiCE: The Infinitely Differentiable Monte-Carlo Estimator , 2018, ICML.