Single Photon in Hierarchical Architecture for Physical Decision Making: Photon Intelligence

Understanding and using photonic processes for intelligent functionalities, referred to as photonic intelligence, has recently attracted interest from a variety of fields, including postsilicon computing for artificial intelligence and decision making in the behavioral sciences. In a past study, we successfully used the wave–particle duality of single photons to solve the two-armed bandit problem, which constitutes one of the important foundations of decision making and reinforcement learning. In this paper, we propose and confirm a hierarchical architecture for single-photon-based decision making that verifies the scalability of the principle. Specifically, the four-armed bandit problem is solved given zero prior knowledge in a two-layer hierarchical architecture, where the polarization of single photons is autonomously adapted in order to effect adequate decision making. In the hierarchical structure, the notion of layer-dependent decisions emerges. The optimal solutions in the coarse layer and the fine...

[1]  John W. Backus,et al.  Can programming be liberated from the von Neumann style?: a functional style and its algebra of programs , 1978, CACM.

[2]  E. Maskin.  Nash Equilibrium and Welfare Optimality , 1999 .

[3]  P. Grangier,et al.  Nonclassical radiation from diamond nanocrystals , 2001, OFC 2001.

[4]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[5]  Thierry Gacoin,et al.  Photo-induced creation of nitrogen-related color centers in diamond nanocrystals under femtosecond illumination , 2004 .

[6]  M. Orrit,et al.  Single-photon sources , 2005 .

[7]  Kyo Inoue,et al.  Performance of various quantum-key-distribution systems using 1.55-μm up-conversion single-photon detectors , 2005 .

[8]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[9]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[10]  Larry A. Coldren,et al.  High-frequency single-photon source with polarization control , 2007 .

[11]  Diamond nanocrystals hosting single nitrogen-vacancy color centers sorted by photon-correlation near-field microscopy. , 2007, Optics letters.

[12]  G. Northoff,et al.  Culture-sensitive neural substrates of human cognition: a transcultural neuroimaging approach , 2008, Nature Reviews Neuroscience.

[13]  J. Busemeyer,et al.  A quantum probability explanation for violations of ‘rational’ decision theory , 2009, Proceedings of the Royal Society B: Biological Sciences.

[14]  Bee-Chung Chen,et al.  Explore/Exploit Schemes for Web Content Optimization , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[15]  M. Zollo,et al.  The neuro-scientific foundations of the exploration-exploitation dilemma , 2010 .

[16]  Taksu Cheon,et al.  Interference and inequality in quantum decision theory , 2010, 1008.2628.

[17]  Song-Ju Kim,et al.  Tug-of-war model for the two-bandit problem: Nonlocally-correlated parallel exploration via resource conservation , 2010, Biosyst..

[18]  H. Vincent Poor,et al.  Cognitive Medium Access: Exploration, Exploitation, and Competition , 2007, IEEE Transactions on Mobile Computing.

[19]  A. Politi,et al.  Multimode quantum interference of photons in multiport integrated devices , 2010, Nature communications.

[20]  Shoko Utsunomiya,et al.  Transient time of an Ising machine based on injection-locked laser network , 2012 .

[21]  Alán Aspuru-Guzik,et al.  Photonic quantum simulators , 2012, Nature Physics.

[22]  Masatoshi Ishikawa,et al.  Ultra high-speed Robot Based on 1 kHz vision system , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Naoya Tate,et al.  Optical security based on near-field processes at the nanoscale , 2012 .

[24]  M. Naruse,et al.  Information physics fundamentals of nanophotonics , 2013, Reports on progress in physics. Physical Society.

[25]  Daniel A. Lidar,et al.  Experimental signature of programmable quantum annealing , 2012, Nature Communications.

[26]  Andrew A. Chien,et al.  Moore's Law: The First Ending and a New Beginning , 2013, Computer.

[27]  ERRATUM: Decision Maker based on Nanoscale Photo-excitation Transfer , 2013, Scientific Reports.

[28]  Song-Ju Kim,et al.  Efficient decision-making by volume-conserving physical object , 2014, ArXiv.

[29]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[30]  Motoichi Ohtsu,et al.  Decision making based on optical excitation transfer via near-field interactions between quantum dots , 2014 .

[31]  Song-Ju Kim,et al.  Amoeba-inspired algorithm for cognitive medium access , 2014 .

[32]  Hiroyuki Mizuno,et al.  24.3 20k-spin Ising chip for combinational optimization problem with CMOS annealing , 2015, 2015 IEEE International Solid-State Circuits Conference - (ISSCC) Digest of Technical Papers.

[33]  C-Y Lu,et al.  Entanglement-based machine learning on a quantum computer. , 2015, Physical review letters.

[34]  T. Gacoin,et al.  Photophysics of single nitrogen-vacancy centers in diamond nanocrystals , 2015, 1501.03714.

[35]  Taiji Sakamoto,et al.  PLC-Based Four-Mode Multi/Demultiplexer With LP11 Mode Rotator on One Chip , 2015, Journal of Lightwave Technology.

[36]  Taiki Takahashi,et al.  Reinforcement learning in depression: A review of computational research , 2015, Neuroscience & Biobehavioral Reviews.

[37]  Song-Ju Kim,et al.  Single-photon decision maker , 2015, Scientific Reports.

[38]  Hideo Mabuchi,et al.  A coherent perceptron for all-optical learning , 2015, 1501.01608.

[39]  M. Frank,et al.  Computational psychiatry as a bridge from neuroscience to clinical applications , 2016, Nature Neuroscience.

[40]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[41]  T. Ebbesen,et al.  Single-plasmon interferences , 2016, Science Advances.

[42]  C. Weedbrook,et al.  Quantum Machine Learning over Infinite Dimensions. , 2016, Physical review letters.