Infomax Control as a Model of Real Time Behavior: Theory and Application to the Detection of Social Contingency

I present a model of behavior for situations in which organisms react to the environment in a manner that maximizes information gain. I call the approach “Infomax control” for it combines the theory of optimal control with information maximization models of perception. The approach is not cognitivist, in that it is better described as a continuous “dance” of actions and reactions with the world, rather than a turntaking inferential process like chess-playing. The approach however is intelligent in that it produces behaviors that optimize long-term information gain. I illustrate how Infomax control can be used to understand the detection of social contingency in 10 month old infants. The results suggest that, while lacking language, by this age infants actively “ask questions” to the environment, i.e., schedule their actions in a manner that maximizes the expected information return. A real time Infomax controller was implemented on a humanoid robot to detect people using contingency information. The system worked robustly requiring little bandwidth and computational cost. This suggest that contingency is indeed a reliable source of information to detect the presence of humans and that the infant brain is likely to capitalize on it to solve this task.

[1]  J. Movellan,et al.  The development of gaze following as a Bayesian systems identification problem , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[2]  Stan Van Hooft Abstract , 2001 .

[3]  Javier R. Movellan,et al.  Perception of Directional Attention , 2001 .

[4]  Javier R. Movellan,et al.  Active Inference in Concept Learning , 2000, NIPS.

[5]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[6]  J. Watson Smiling, cooing, and "the game." , 1972 .

[7]  G. Fricchione Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[8]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[9]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[10]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.