Category Theoretic Analysis of Photon-Based Decision Making

Decision making is a vital function in this age of machine learning and artificial intelligence, yet its physical realization and theoretical fundamentals are still not completely understood. In our former study, we demonstrated that single-photons can be used to make decisions in uncertain, dynamically changing environments. The two-armed bandit problem was successfully solved using the dual probabilistic and particle attributes of single photons. In this study, we present a category theoretic modeling and analysis of single-photon-based decision making, including a quantitative analysis that is in agreement with the experimental results. A category theoretic model reveals the complex interdependencies of subject matter entities in a simplified manner, even in dynamically changing environments. In particular, the octahedral and braid structures in triangulated categories provide a better understanding and quantitative metrics of the underlying mechanisms of a single-photon decision maker. This study provides both insight and a foundation for analyzing more complex and uncertain problems, to further machine learning and artificial intelligence.

[1]  Song-Ju Kim,et al.  Harnessing the Computational Power of Fluids for Optimization of Collective Decision Making , 2016 .

[2]  Bulletin de la Société Mathématique de France , 2022 .

[3]  Song-Ju Kim,et al.  Ultrafast photonic reinforcement learning based on laser chaos , 2017, Scientific Reports.

[4]  Hidehiko Takahashi.  Molecular neuroimaging of emotional decision-making , 2011, Neuroscience Research.

[5]  Dominic R. Verity,et al.  ∞-Categories for the Working Mathematician , 2018 .

[6]  Makoto Naruse,et al.  Single Photon in Hierarchical Architecture for Physical Decision Making: Photon Intelligence , 2016 .

[7]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[8]  Song-Ju Kim,et al.  Single-photon decision maker , 2015, Scientific Reports.

[9]  Yi Peng,et al.  A Group Decision Making Model for Integrating Heterogeneous Information , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Song-Ju Kim,et al.  Efficient decision-making by volume-conserving physical object , 2014, ArXiv.

[11]  Birger Iversen,et al.  Octahedra and braids , 1986 .

[12]  T. Gacoin,et al.  Photophysics of single nitrogen-vacancy centers in diamond nanocrystals , 2015, 1501.03714.

[13]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[14]  Song-Ju Kim,et al.  Tug-of-War Model for Multi-armed Bandit Problem , 2010, UC.

[15]  T. Gacoin,et al.  Surface-induced charge state conversion of nitrogen-vacancy defects in nanodiamonds , 2010, 1008.2276.

[16]  Motoichi Ohtsu,et al.  Decision making based on optical excitation transfer via near-field interactions between quantum dots , 2014 .

[17]  H. Vincent Poor,et al.  Cognitive Medium Access: Exploration, Exploitation, and Competition , 2007, IEEE Transactions on Mobile Computing.

[18]  Taksu Cheon,et al.  Interference and inequality in quantum decision theory , 2010, 1008.2628.

[19]  Song-Ju Kim,et al.  Amoeba-inspired algorithm for cognitive medium access , 2014 .

[20]  William H Press,et al.  Bandit solutions provide unified ethical models for randomized clinical trials and comparative effectiveness research , 2009, Proceedings of the National Academy of Sciences.

[21]  J. Busemeyer,et al.  A quantum probability explanation for violations of ‘rational’ decision theory , 2009, Proceedings of the Royal Society B: Biological Sciences.

[22]  L. Nicolaescu,et al.  THE COHOMOLOGY OF SHEAVES , 2011 .

[23]  Bee-Chung Chen,et al.  Explore/Exploit Schemes for Web Content Optimization , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[24]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[25]  Motoichi Ohtsu,et al.  Decision Maker based on Nanoscale Photo-excitation Transfer , 2013, Scientific reports.

[26]  Song-Ju Kim,et al.  Tug-of-war model for the two-bandit problem: Nonlocally-correlated parallel exploration via resource conservation , 2010, Biosyst..

[27]  P. Grangier,et al.  Nonclassical radiation from diamond nanocrystals , 2001, OFC 2001.

[28]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[29]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[30]  Ken Brown.  Introduction to Category Theory , .