Spatial-photonic Boltzmann machines: low-rank combinatorial optimization and statistical learning by spatial light modulation

The spatial-photonic Ising machine (SPIM) [D. Pierangeli et al., Phys. Rev. Lett. 122, 213902 (2019)] is a promising optical architecture utilizing spatial light modulation for solving large-scale combinatorial optimization problems efficiently. However, the SPIM can accommodate Ising problems with only rank-one interaction matrices, which limits its applicability to various real-world problems. In this Letter, we propose a new computing model for the SPIM that can accommodate any Ising problem without changing its optical implementation. The proposed model is particularly efficient for Ising problems with low-rank interaction matrices, such as knapsack problems. Moreover, the model acquires learning ability and can thus be termed a spatial-photonic Boltzmann machine (SPBM). We demonstrate that learning, classification, and sampling of the MNIST handwritten digit images are achieved efficiently using SPBMs with low-rank interactions. Thus, the proposed SPBM model exhibits higher practical applicability to various problems of combinatorial optimization and statistical learning, without losing the scalability inherent in the SPIM architecture.

[1]  S. Tayur,et al.  Optimization with photonic wave-based annealers , 2022, Philosophical Transactions of the Royal Society A.

[2]  T. Matsumori,et al.  Application of QUBO solver using black-box optimization to structural design for resonance avoidance , 2022, Scientific Reports.

[3]  P. McMahon,et al.  Ising machines as hardware solvers of combinatorial optimization problems , 2022, Nature Reviews Physics.

[4]  Andrej Risteski,et al.  Sampling Approximately Low-Rank Ising Models: MCMC meets Variational Methods , 2022, COLT.

[5]  G. Van der Sande,et al.  Noise-injected analog Ising machines enable ultrafast statistical sampling and machine learning , 2021, Nature Communications.

[6]  Zuyuan He,et al.  Quadrature Photonic Spatial Ising Machine , 2021, Optics letters.

[7]  Kazuyuki Aihara,et al.  Accelerating numerical simulation of continuous-time Boolean satisfiability solver using discrete gradient , 2021, Commun. Nonlinear Sci. Numer. Simul..

[8]  Yisheng Fang,et al.  Antiferromagnetic spatial photonic Ising machine through optoelectronic correlation computing , 2021, Communications Physics.

[9]  Blake A. Wilson,et al.  Machine learning framework for quantum sampling of highly constrained, continuous optimization problems , 2021, Applied Physics Reviews.

[10]  G. Parisi,et al.  Optical computation of a spin glass dynamics with tunable complexity , 2020, Proceedings of the National Academy of Sciences.

[11]  Massimiliano Di Ventra,et al.  Efficient solution of Boolean satisfiability problems with digital memcomputing , 2020, Scientific Reports.

[12]  S. Gigan,et al.  Scalable spin-glass optical simulator , 2020, Physical Review Applied.

[13]  C. Conti,et al.  Adiabatic evolution on a spatial-photonic Ising machine , 2020, Optica.

[14]  Hideyuki Suzuki,et al.  Timescales of Boolean satisfiability solver using continuous-time dynamical system , 2020, Commun. Nonlinear Sci. Numer. Simul..

[15]  Davide Pierangeli,et al.  Noise-enhanced spatial-photonic Ising machine , 2020, Nanophotonics.

[16]  K. Tsuda,et al.  Designing metamaterials with quantum annealing and factorization machines , 2020 .

[17]  Nozomu Togawa,et al.  A Fully-Connected Ising Model Embedding Method and Its Evaluation for CMOS Annealing Machines , 2019, IEICE Trans. Inf. Syst..

[18]  Ken-ichi Kawarabayashi,et al.  Binary optimization by momentum annealing. , 2019, Physical review. E.

[19]  C. Conti,et al.  Large-Scale Photonic Ising Machine by Spatial Light Modulation. , 2019, Physical review letters.

[20]  Hayato Goto,et al.  Combinatorial optimization by simulating adiabatic bifurcations in nonlinear Hamiltonian systems , 2019, Science Advances.

[21]  Jaijeet S. Roychowdhury,et al.  OIM: Oscillator-based Ising Machines for Solving Combinatorial Optimisation Problems , 2019, UCNC.

[22]  Kazuyuki Aihara,et al.  Destabilization of Local Minima in Analog Spin Systems by Correction of Amplitude Heterogeneity. , 2018, Physical review letters.

[23]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[24]  Massimiliano Di Ventra,et al.  Polynomial-time solution of prime factorization and NP-hard problems with digital memcomputing machines , 2015, Chaos.

[25]  H. Tamura,et al.  Accelerator Architecture for Combinatorial Optimization Problems , 2017 .

[26]  Ken-ichi Kawarabayashi,et al.  A coherent Ising machine for 2000-node optimization problems , 2016, Science.

[27]  Hiroyuki Mizuno,et al.  A 20k-Spin Ising Chip to Solve Combinatorial Optimization Problems With CMOS Annealing , 2016, IEEE Journal of Solid-State Circuits.

[28]  Aidan Roy,et al.  A practical heuristic for finding graph minors , 2014, ArXiv.

[29]  Andrew Lucas,et al.  Ising formulations of many NP problems , 2013, Front. Physics.

[30]  Hideyuki Suzuki,et al.  Monte Carlo simulation of classical spin models with chaotic billiards. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Hideyuki Suzuki,et al.  Chaotic Boltzmann machines , 2013, Scientific Reports.

[32]  Geoffrey E. Hinton,et al.  An Efficient Learning Procedure for Deep Boltzmann Machines , 2012, Neural Computation.

[33]  Zoltán Toroczkai,et al.  Optimization hardness as transient chaos in an analog approach to constraint satisfaction , 2011, ArXiv.

[34]  M. W. Johnson,et al.  Quantum annealing with manufactured spins , 2011, Nature.

[35]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[36]  João Pedro Pedroso,et al.  Heuristics and exact methods for number partitioning , 2010, Eur. J. Oper. Res..

[37]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[38]  Yoshua Bengio,et al.  Classification using discriminative restricted Boltzmann machines , 2008, ICML '08.

[39]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[40]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[41]  S. Mertens A physicist's approach to number partitioning , 2000, Theor. Comput. Sci..

[42]  David Pisinger,et al.  Core Problems in Knapsack Algorithms , 1999, Oper. Res..

[43]  S. Mertens Phase Transition in the Number Partitioning Problem , 1998, cond-mat/9807077.

[44]  J. Fontanari,et al.  PROBABILISTIC ANALYSIS OF THE NUMBER PARTITIONING PROBLEM , 1998, adap-org/9801002.

[45]  Emile H. L. Aarts,et al.  Combinatorial Optimization on a Boltzmann Machine , 1989, J. Parallel Distributed Comput..

[46]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[47]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[48]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[49]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[50]  D. Mattis Solvable spin systems with random interactions , 1976 .

[51]  Shun-ichi Amari,et al.  Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements , 1972, IEEE Transactions on Computers.