Dynamical, value-based decision making among N options

Decision making is a fundamental capability of autonomous systems. As decision making is a process which happens over time, it can be well modeled by dynamical systems. Often, decisions are made on the basis of perceived values of the underlying options and the desired outcome is to select the option with the highest value. This can be encoded as a bifurcation which produces a stable equilibrium corresponding to the high-value option. When some options have identical values, it is natural to design the decision-making model to be indifferent among the equally-valued options, leading to symmetries in the underlying dynamical system. For example, when all $N$ options have identical values, the dynamical system should have $S_N$ symmetry. Unfortunately, constructing a dynamical system that unfolds the $S_N$-symmetric pitchfork bifurcation is non-trivial. In this paper, we develop a method to construct an unfolding of the pitchfork bifurcation with a symmetry group that is a significant subgroup of $S_N$. The construction begins by parsing the decision among $N$ options into a hierarchical set of $N-1$ binary decisions encoded in a binary tree. By associating the unfolding of a standard $S_2$-symmetric pitchfork bifurcation with each of these binary decisions, we develop an unfolding of the pitchfork bifurcation with symmetries corresponding to isomorphisms of the underlying binary tree.

[1]  M. Golubitsky,et al.  Singularities and groups in bifurcation theory , 1985 .

[2]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[3]  Vaibhav Srivastava,et al.  Multiagent Decision-Making Dynamics Inspired by Honeybees , 2017, IEEE Transactions on Control of Network Systems.

[4]  Nathan F. Lepora,et al.  Embodied Choice: How Action Influences Perceptual Decision Making , 2015, PLoS Comput. Biol..

[5]  Raymond J. Dolan,et al.  The anatomy of choice: active inference and agency , 2013, Front. Hum. Neurosci..

[6]  Justus H. Piater,et al.  Computational models of affordance in robotics: a taxonomy and systematic classification , 2017, Adapt. Behav..

[7]  Tim Kovacs,et al.  On optimal decision-making in brains and social insect colonies , 2009, Journal of The Royal Society Interface.

[8]  Naomi Ehrich Leonard,et al.  The Dynamics of Multi-agent Multi-option Decision Making , 2019 .

[9]  W. Marsden I and J , 2012 .

[10]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[11]  W. Davis The Ecological Approach to Visual Perception , 2012 .

[12]  Thomas Schlegel,et al.  Stop Signals Provide Cross Inhibition in Collective Decision-making , 2022 .

[13]  Leslie Pack Kaelbling,et al.  Ecological Robotics , 1998, Adapt. Behav..

[14]  M. Golubitsky,et al.  Singularities and Groups in Bifurcation Theory: Volume I , 1984 .

[15]  Hadas Kress-Gazit,et al.  Synthesis for Robots: Guarantees and Feedback for Robot Behavior , 2018, Annu. Rev. Control. Robotics Auton. Syst..

[16]  三嶋 博之 The theory of affordances , 2008 .

[17]  Andreagiovanni Reina,et al.  Model of the best-of-N nest-site selection process in honeybees. , 2016, Physical review. E.

[18]  Paul B. Reverdy Two paths to finding the pitchfork bifurcation in motivation dynamics , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[19]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  N. Franks,et al.  A Mechanism for Value-Sensitive Decision-Making , 2013, PloS one.

[21]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[22]  Daniel E. Koditschek,et al.  A Dynamical System for Prioritizing and Coordinating Motivations , 2017, SIAM J. Appl. Dyn. Syst..

[23]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[24]  R. G. Möller Groups acting on graphs , 1991 .

[25]  M. Golubitsky,et al.  The Symmetry Perspective: From Equilibrium to Chaos in Phase Space and Physical Space , 2002 .