Homeokinesis - A new principle to back up evolution with learning

It is well known that individual learning can speed up artificial evolution enormously. However both supervised learning and reinforcement learning require specific learning goals which usually are not available or difficult to find. We introduce a new principle – homeokinesis –which is completely unspecific and yet induces specific, seemingly goal–oriented behaviors of an agent in a complex external world. The principle is based on the assumption that the agent is equipped with an adaptive model of its behavior. A learning signal for both the model and the controller is derived from the misfit between the real behavior of the agent in the world and that predicted by the model. If the structural complexity of the model is chosen adequately, this misfit is minimized if the agent exhibits a smooth controlled behavior. The principle is explicated by two examples. We moreover discuss how functional modularization emerges in a natural way in a structured system from a mechanism of competition for the best internal representation.