Simulating an agent’s decision-making process in black-box managerial environment: An estimation-and-optimisation approach

Abstract With the growing need to guide decision-making in today’s complex managerial environment, researchers of the Operations Research/Management Science community have shown a considerable interest in modelling complex managerial systems using the agent-based modelling and simulation technique. This paper presents an estimation-and-optimisation (ESTOPT) architecture to simulate an agent’s decision-making process in black-box managerial environment. An ESTOPT agent’s behaviour is considered as a two-stage process of solving its optimisation problem, some parameters of which are uncertain and need to be estimated. In the first stage, the agent collects and records information for estimation; in the next stage, it attempts to solve the optimisation problem. The solution guides the agent’s actions on the environment which, in turn, provides the agent with new information and payoff as feedback. In this paper, two agent-based models are introduced to demonstrate the implementation of the ESTOPT approach. The simulation outcomes compare favourably with both empirical and theoretical results, suggesting that the ESTOPT approach can be used to simulate an agent’s decision-making process in black-box managerial environment.

[1]  Duncan A. Robertson,et al.  The Dynamics of Strategy: Mastering Strategic Landscapes of the Firm , 2009 .

[2]  David Besanko,et al.  Logit Demand Estimation Under Competitive Pricing Behavior: An Equilibrium Framework , 1998 .

[3]  Hazhir Rahmandad,et al.  Heterogeneity and Network Structure in the Dynamics of Diffusion: Comparing Agent-Based and Differential Equation Models , 2004, Manag. Sci..

[4]  Master Gardener,et al.  Mathematical games: the fantastic combinations of john conway's new solitaire game "life , 1970 .

[5]  Angappa Gunasekaran,et al.  Bottom-Up Approach based on Internet of things for Order Fulfillment in a Collaborative Warehousing Environment , 2015 .

[6]  Bo Chen,et al.  A Review of the Applications of Agent Technology in Traffic and Transportation Systems , 2010, IEEE Transactions on Intelligent Transportation Systems.

[7]  Herbert Gintis,et al.  Handbook of Computational Economics: Agent-Based Computational Economics (Handbook of Computational Economics S.) by K. L. Judd, L. Tesfatsion, M. D. Intriligator and Kenneth J. Arrow (eds.) , 2007, J. Artif. Soc. Soc. Simul..

[8]  Charles M. Macal,et al.  Everything you need to know about agent-based modelling and simulation , 2016, J. Simulation.

[9]  Elias G. Carayannis,et al.  Knowledge Arbitrage, Serendipity, and Acquisition Formality: Their Effects on Sustainable Entrepreneurial Activity in Regions , 2011, IEEE Transactions on Engineering Management.

[10]  John H. Conway,et al.  The game of life. , 1996, The Hastings Center report.

[11]  Ilaria Giannoccaro,et al.  Examining the Roles of Product Complexity and Manager Behavior on Product Design Decisions: An Agent-Based Study Using NK Simulation , 2016, IEEE Transactions on Engineering Management.

[12]  R. Axelrod Reviews book & software , 2022 .

[13]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[14]  Lean Yu,et al.  An agent-based model for investigating the impact of distorted supply-demand information on China's resale housing market , 2018, J. Comput. Sci..

[15]  Levent Yilmaz,et al.  Agent-based simulation applications in marketing research: an integrated review , 2014, J. Simulation.

[16]  U. Fischbacher,et al.  The nature of human altruism , 2003, Nature.

[17]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[18]  William Rand,et al.  Agent-Based Modeling in Marketing: Guidelines for Rigor , 2011 .

[19]  Ron Sun,et al.  Cognitive Social Simulation Incorporating Cognitive Architectures , 2007, IEEE Intelligent Systems.

[20]  Oded Berger-Tal,et al.  The Exploration-Exploitation Dilemma: A Multidisciplinary Framework , 2014, PloS one.

[21]  T. C. Edwin Cheng,et al.  Evolutionary location and pricing strategies for service merchants in competitive O2O markets , 2016, Eur. J. Oper. Res..

[22]  Soundar Kumara,et al.  A market-based approach for dynamic vehicle deployment planning using radio frequency identification (RFID) information , 2010 .

[23]  Anand Nair,et al.  Complexity and Adaptivity in Supply Networks: Building Supply Network Theory Using a Complex Adaptive Systems Perspective , 2007, Decis. Sci..

[24]  Benoit Gaudou,et al.  BDI agents in social simulations: a survey , 2016, The Knowledge Engineering Review.

[25]  D. Watts,et al.  Influentials, Networks, and Public Opinion Formation , 2007 .

[26]  A. N. Kolmogorov,et al.  Foundations of the theory of probability , 1960 .

[27]  A. Colman,et al.  The complexity of cooperation: Agent-based models of competition and collaboration , 1998, Complex..

[28]  José M. Vidal,et al.  Supply network topology and robustness against disruptions – an investigation using multi-agent model , 2011 .

[29]  Christine A. Shoemaker,et al.  Managing competitive municipal solid waste treatment systems: An agent-based approach , 2017, Eur. J. Oper. Res..

[30]  Tina Balke,et al.  How Do Agents Make Decisions? A Survey , 2014, J. Artif. Soc. Soc. Simul..

[31]  T. C. Edwin Cheng,et al.  Evolutionary Location and Pricing Strategies in Competitive Hierarchical Distribution Systems: A Spatial Agent-Based Model , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Peer-Olaf Siebers,et al.  Discrete-event simulation is dead, long live agent-based simulation! , 2010, J. Simulation.

[33]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[34]  John R. Koza,et al.  Hidden Order: How Adaptation Builds Complexity. , 1995, Artificial Life.

[35]  R. Mark Isaac,et al.  Group Size Effects in Public Goods Provision: The Voluntary Contributions Mechanism , 1988 .

[36]  A. S. Getchell,et al.  Agent-based Modeling , 2008 .

[37]  J. Bergh,et al.  Evolutionary models in economics: a survey of methods and building blocks , 2010 .

[38]  Dana H. Ballard,et al.  Learning to perceive and act by trial and error , 1991, Machine Learning.

[39]  Charles R. Plott,et al.  Public goods provision in an experimental environment , 1985 .

[40]  Wai Kin Chan,et al.  On the modelling of transportation evacuation: an agent-based discrete-event hybrid-space approach , 2014, J. Simulation.

[41]  H. Peyton Young,et al.  Learning in a Black Box , 2013 .

[42]  Elias G. Carayannis,et al.  Entrepreneurship ecosystems: an agent-based simulation approach , 2016, The Journal of Technology Transfer.

[43]  Gautam Biswas,et al.  On the Evolutionary Dynamics of Supply Network Topologies , 2007, IEEE Transactions on Engineering Management.

[44]  T. Schelling Micromotives and Macrobehavior , 1978 .

[45]  Maria J. Serna,et al.  Cooperation through social influence , 2015, Eur. J. Oper. Res..

[46]  Soundar R. T. Kumara,et al.  Survivability of multiagent-based supply networks: a topological perspect , 2004, IEEE Intelligent Systems.

[47]  John D. C. Little,et al.  A Logit Model of Brand Choice Calibrated on Scanner Data , 2011, Mark. Sci..

[48]  F. Chan,et al.  Comparative study of adaptability and flexibility in distributed manufacturing supply chains , 2010, Decis. Support Syst..

[49]  Byungun Yoon,et al.  A systematic approach for new service concept generation: Application of agent-based simulation , 2014, Expert Syst. Appl..

[50]  M. Batty Generative social science: Studies in agent-based computational modeling , 2008 .

[51]  Romain Michon,et al.  The Black Box , 2013, NIME.

[52]  Bruce Edmonds,et al.  From KISS to KIDS - An 'Anti-simplistic' Modelling Approach , 2004, MABS.

[53]  Eric van Damme,et al.  Non-Cooperative Games , 2000 .