Gaze Allocation Analysis for a Visually Guided Manipulation Task

Findings from eye movement research in humans have demonstrated that the task determines where to look. One hypothesis is that the purpose of looking is to reduce uncertainty about properties relevant to the task. Following this hypothesis, we define a model that poses the problem of where to look as one of maximising task performance by reducing task relevant uncertainty. We implement and test our model on a simulated humanoid robot which has to move objects from a table into containers. Our model outperforms and is more robust than two other baseline schemes in terms of task performance whilst varying three environmental conditions, reach/grasp sensitivity, observation noise and the camera’s field of view.

[1]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[2]  Giulio Sandini,et al.  The iCub humanoid robot: an open platform for research in embodied cognition , 2008, PerMIS.

[3]  Britta Wrede,et al.  Optimisation of gaze movement for multitasking using rewards , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[5]  Michael O. Duff,et al.  Reinforcement Learning Methods for Continuous-Time Markov Decision Problems , 1994, NIPS.

[6]  Mary M Hayhoe,et al.  Vision in the natural world. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[7]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[8]  Giulio Sandini,et al.  An experimental evaluation of a novel minimum-jerk cartesian controller for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[10]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[11]  M. Land Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[12]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[13]  Simone Frintrop,et al.  VOCUS: A Visual Attention System for Object Detection and Goal-Directed Search , 2006, Lecture Notes in Computer Science.

[14]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[15]  Balaraman Ravindran,et al.  Where do i look now? Gaze allocation during visually guided manipulation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  A. Cassandra,et al.  Exact and approximate algorithms for partially observable markov decision processes , 1998 .