Communication as moving target tracking

We view communication partners as moving targets. Achieving the goal of communication, thus, requires tracking the conversational trajectory of the partner in real time. We formalize this as dynamic inference with an action-perception-learning cycle and use sequential Bayesian estimation to do that. Our information-theoretic, dynamic Bayesian formulation suggests to understand communication as a Markov decision process where one participant tries to simultaneously improve predictions about its partner’s future state, manipulate the partner into states that maximize predictive information and minimize decision costs. The dynamic inference cycle model offers an overarching framework in which the mathematical tools developed in different fields can be used for modelling communication. It also helps develop technologies for multimodal embodied interaction and human-like cognitive agents.

[1]  Peter Stone,et al.  Empowerment for continuous agent—environment systems , 2011, Adapt. Behav..

[2]  Eric Eaton,et al.  Selective Transfer Between Learning Tasks Using Task-Based Boosting , 2011, AAAI.

[3]  A. U.S.,et al.  Predictability , Complexity , and Learning , 2002 .

[4]  Matthew W. Crocker,et al.  The influence of recent scene events on spoken comprehension: Evidence from eye movements , 2007 .

[5]  Byoung-Tak Zhang,et al.  System identification using evolutionary Markov chain Monte Carlo , 2001, J. Syst. Archit..

[6]  A. Clark.  Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[7]  Doina Precup,et al.  An information-theoretic approach to curiosity-driven reinforcement learning , 2012, Theory in Biosciences.

[8]  J. Fuster.  The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[9]  David Barber,et al.  Bayesian Time Series Models , 2011 .

[10]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[11]  Ralf Der,et al.  Higher Coordination With Less Control—A Result of Information Maximization in the Sensorimotor Loop , 2009, Adapt. Behav..

[12]  Byoung-Tak Zhang,et al.  Hypernetworks: A Molecular Evolutionary Architecture for Cognitive Learning and Memory , 2008, IEEE Computational Intelligence Magazine.

[13]  Petra Wagner,et al.  Rapid entrainment to spontaneous speech: A comparison of oscillator models , 2012, CogSci.

[14]  Byoung-Tak Zhang,et al.  Information-Theoretic Objective Functions for Lifelong Learning , 2013, AAAI Spring Symposium: Lifelong Machine Learning.

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  Byoung-Tak Zhang,et al.  Sparse Population Code Models of Word Learning in Concept Drift , 2012, CogSci.

[17]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[18]  Byoung-Tak Zhang,et al.  Neural networks that teach themselves through genetic discovery of novel examples , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[19]  Michael J. Spivey,et al.  The Continuity Of Mind , 2008 .

[20]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[21]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[22]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[23]  Jens Allwood,et al.  Dimensions of embodied communication : towards a typology of embodied communication , 2008 .

[24]  Anna K. Kuhlen,et al.  Two Minds, One Dialog , 2010 .

[25]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.