Simulation of a Cellular Automaton with Markov Chains: Applications in Self-Organized Dynamical Systems

over the past years, technology has allowed information technology to contemplate complex events as well as complex semantic features to predict what types of "thoughts" are being conceptualized. The introduction of the neuro-robotics field allows a mix of different disciplines to inter-collate and produce actual results that could be considered outputs of a science-fiction novel 20 twenty years ago. In the present work, we attempted to present an example of how an automaton can move in an environment with obstacles, by regulating its behavior so as to allow a decision based on rewards and penalties. Examples of the robotic behavior, running on a virtual environment are presented, along with a discussion of its different possibilities expressed as a penalty function for the behavior of the robot.

[1]  David Stirzaker,et al.  Advice to hedgehogs, or, constants can vary , 2000, The Mathematical Gazette.

[2]  A. Weitzenfeld,et al.  Behavioral match evaluation of spatial cognition in rats and robots , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  S. Lakshmivarahan,et al.  Learning Algorithms Theory and Applications , 1981 .

[4]  Jeffrey L. Krichmar,et al.  Neuromodulation as a robot controller , 2009, IEEE Robotics & Automation Magazine.

[5]  Hao Wu,et al.  Projected metastable Markov processes and their estimation with observable operator models. , 2015, The Journal of chemical physics.

[6]  Rui Zhen Tan,et al.  A computational model for how cells choose temporal or spatial sensing during chemotaxis , 2018, PLoS Comput. Biol..

[7]  Daniel Bullock,et al.  Integrating robotics and neuroscience: brains for robots, bodies for brains , 2007, Adv. Robotics.

[8]  J. Neumann,et al.  Physical Applications of the Ergodic Hypothesis. , 1932, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Andrea Cherubini,et al.  The Three Laws of Neurorobotics: A Review on What Neurorehabilitation Robots Should Do for Patients and Clinicians , 2016, Journal of medical and biological engineering.

[10]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[11]  Ann Nowé,et al.  Colonies of learning automata , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[13]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[14]  Emanuele Raineri,et al.  Faster exact Markovian probability functions for motif occurrences: a DFA-only approach , 2008, Bioinform..

[15]  M. Kawato,et al.  From self-observation to imitation: Visuomotor association on a robotic hand , 2008, Brain Research Bulletin.

[16]  Rüdiger Dillmann,et al.  A visual tracking model implemented on the iCub robot as a use case for a novel neurorobotic toolkit integrating brain and physics simulation , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[17]  Scott L. Miller,et al.  Probability and Random Processes : With Applications to Signal Processing and Communications , 2012 .

[18]  G. Birkhoff.  Proof of the Ergodic Theorem , 1931, Proceedings of the National Academy of Sciences.

[19]  Gerald M. Edelman,et al.  Adaptation of orienting behavior: from the barn owl to a robotic system , 1999, IEEE Trans. Robotics Autom..

[20]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[21]  Athanasios V. Vasilakos,et al.  Ergodic discretized estimator learning automata with high accuracy and high adaptation rate for nonstationary environments , 1992, Neurocomputing.

[22]  M. Matarić.  Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior , 1998, Trends in Cognitive Sciences.

[23]  Markus Plank,et al.  Adaptation of a haptic robot in a 3T fMRI. , 2011, Journal of visualized experiments : JoVE.

[24]  Mingqing Xiao,et al.  Synchronization of Nonlinearly and Stochastically Coupled Markovian Switching Networks via Event-Triggered Sampling , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Gabriel J. Lord,et al.  Stochastic Methods in Neuroscience , 2009 .