Category theoretic analysis of single-photon decision maker

Decision making is a vital function in the era of artificial intelligence; however, its physical realizations and their theoretical fundamentals are not yet known. In our former study [Sci. Rep. 5, 513253 (2015)], we demonstrated that single photons can be used to make decisions in uncertain, dynamically changing environments. The multi-armed bandit problem was successfully solved using the dual probabilistic and particle attributes of single photons. Herein, we present the category theoretic foundation of the single-photon-based decision making, including quantitative analysis that agrees well with the experimental results. The category theoretic model unveils complex interdependencies of the entities of the subject matter in the most simplified manner, including a dynamically changing environment. In particular, the octahedral structure in triangulated categories provides a clear understanding of the underlying mechanisms of the single-photon decision maker. This is the first demonstration of a category theoretic interpretation of decision making, and provides a solid understanding and a design fundamental for intelligence.

[1]  Bee-Chung Chen,et al.  Explore/Exploit Schemes for Web Content Optimization , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[2]  Song-Ju Kim,et al.  Tug-of-war model for the two-bandit problem: Nonlocally-correlated parallel exploration via resource conservation , 2010, Biosyst..

[3]  Ken Brown Introduction to Category Theory , .

[4]  H. Vincent Poor,et al.  Cognitive Medium Access: Exploration, Exploitation, and Competition , 2007, IEEE Transactions on Mobile Computing.

[5]  Song-Ju Kim,et al.  Amoeba-inspired algorithm for cognitive medium access , 2014 .

[6]  Birger Iversen,et al.  Octahedra and braids , 1986 .

[7]  Song-Ju Kim,et al.  Tug-of-War Model for Multi-armed Bandit Problem , 2010, UC.

[8]  Song-Ju Kim,et al.  Single-photon decision maker , 2015, Scientific Reports.

[9]  William H Press,et al.  Bandit solutions provide unified ethical models for randomized clinical trials and comparative effectiveness research , 2009, Proceedings of the National Academy of Sciences.

[10]  Motoichi Ohtsu,et al.  Decision making based on optical excitation transfer via near-field interactions between quantum dots , 2014 .

[11]  柏原 正樹,et al.  Categories and Sheaves , 2005 .

[12]  A. Minelli BIO , 2009, Evolution & Development.

[13]  Taksu Cheon,et al.  Interference and inequality in quantum decision theory , 2010, 1008.2628.

[14]  J. Busemeyer,et al.  A quantum probability explanation for violations of ‘rational’ decision theory , 2009, Proceedings of the Royal Society B: Biological Sciences.

[15]  L. Nicolaescu,et al.  THE COHOMOLOGY OF SHEAVES , 2011 .

[16]  Song-Ju Kim,et al.  Efficient decision-making by volume-conserving physical object , 2014, ArXiv.

[17]  Dominic R. Verity,et al.  ∞-Categories for the Working Mathematician , 2018 .

[18]  T. Gacoin,et al.  Surface-induced charge state conversion of nitrogen-vacancy defects in nanodiamonds , 2010, 1008.2276.

[19]  P. Grangier,et al.  Nonclassical radiation from diamond nanocrystals , 2001, OFC 2001.

[20]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[21]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[23]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[24]  Hidehiko Takahashi Molecular neuroimaging of emotional decision-making , 2011, Neuroscience Research.