An Attentional Approach to Human–Robot Interactive Manipulation

Human robot collaborative work requires interactive manipulation and object handover. During the execution of such tasks, the robot should monitor manipulation cues to assess the human intentions and quickly determine the appropriate execution strategies. In this paper, we present a control architecture that combines a supervisory attentional system with a human aware manipulation planner to support effective and safe collaborative manipulation. After detailing the approach, we present experimental results describing the system at work with different manipulation tasks (give, receive, pick, and place).

[1]  Matthieu Herrb,et al.  G/sup en/oM: a tool for the specification and the implementation of operating modules in a distributed robot architecture , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[2]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[3]  Cynthia Breazeal,et al.  Cost-Based Anticipatory Action Selection for Human–Robot Fluency , 2007, IEEE Transactions on Robotics.

[4]  Charles C. Kemp,et al.  Human-Robot Interaction for Cooperative Manipulation: Handing Objects to One Another , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Gheorghe Mogan,et al.  Evaluating Human-Robot Interaction during a Manipulation Experiment Conducted in Immersive Virtual Reality , 2011, HCI.

[6]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[7]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[8]  Zbigniew Michalewicz,et al.  An Evolutionary Approach , 2004 .

[9]  Karim Abdel-Malek,et al.  A New Discomfort Function for Optimization-Based Posture Prediction , 2005 .

[10]  Silvia Rossi,et al.  Cognitive control in cognitive robotics: Attentional executive control , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[11]  B. Scassellati.  Imitation and mechanisms of joint attention: a developmental structure for building social skills on a humanoid robot , 1999 .

[12]  Daniel Sidobre,et al.  Efficient models for grasp planning with a multi-fingered hand , 2012, Robotics Auton. Syst..

[13]  Michael A. Arbib,et al.  Schema theory , 1998 .

[14]  Silvia Rossi,et al.  Attentional human-robot interaction in simple manipulation tasks , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[16]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[17]  Silvia Rossi,et al.  An extensible architecture for robust multimodal human-robot communication , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  John W. Senders,et al.  The Human Operator as a Monitor and Controller of Multidegree of Freedom Systems , 1964 .

[19]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[20]  Rachid Alami,et al.  A Human-Aware Manipulation Planner , 2012, IEEE Transactions on Robotics.

[21]  Juan Cort.  Sampling-Based Path Planning on Configuration-Space Costmaps , 2010 .

[22]  Bruno Siciliano.  Advanced Bimanual Manipulation - Results from the DEXMART Project , 2012, Springer Tracts in Advanced Robotics.

[23]  Minoru Asada,et al.  A constructive model for the development of joint attention , 2003, Connect. Sci..

[24]  Tamio Arai,et al.  Distributed Autonomous Robotic Systems 3 , 1998 .

[25]  D. Kahneman.  Attention and Effort , 1973 .

[26]  Antonio Origlia,et al.  Attentional and emotional regulation in human-robot interaction , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[27]  William Rowan,et al.  The Study of Instinct , 1953 .

[28]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[29]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[30]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[31]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[32]  J. C. Johnston,et al.  Attentional limitations in dual-task performance. , 1998 .

[33]  Silvia Rossi,et al.  Periodic Adaptive Activation of Behaviors in Robotic Systems , 2008, Int. J. Pattern Recognit. Artif. Intell..

[34]  Rachid Alami,et al.  Synthesizing Robot Motions Adapted to Human Presence , 2010 .

[35]  H. Evans.  The Study of Instinct , 1952 .

[36]  Andrea Lockerd Thomaz,et al.  Effects of nonverbal communication on efficiency and robustness in human-robot teamwork , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Abdenour Labed,et al.  Stochastic optimization-based approach for multifingered grasps synthesis , 2010, Robotica.

[38]  F. Kaplan,et al.  The challenges of joint attention , 2006 .

[39]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[40]  Stefan Berchtold,et al.  A scalable optimizer for automatically generated manipulator motions , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[41]  Rachid Alami,et al.  A Task Planner for an Autonomous Social Robot , 2008, DARS.

[42]  Silvia Rossi,et al.  Attentional Action Selection Using Reinforcement Learning , 2012, SAB.

[43]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[44]  Rachid Alami,et al.  Planning human-aware motions using a sampling-based costmap planner , 2011, 2011 IEEE International Conference on Robotics and Automation.

[45]  Matthieu Herrb,et al.  A tool for the specification and the implementation of operating modules in a distributed robot architecture , 1999 .

[46]  Silvia Rossi,et al.  Attentive Monitoring Strategies in a Behavior-Based Robotic System: An Evolutionary Approach , 2010, 2010 International Conference on Emerging Security Technologies.

[47]  Khoi Nguyen,et al.  From motion planning to trajectory control with bounded jerk for service manipulator robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[48]  Sebastian Lang,et al.  Providing the basis for human-robot-interaction: a multi-modal attention system for a mobile robot , 2003, ICMI '03.

[49]  Rachid Alami,et al.  SHARY: A Supervision System Adapted to Human-Robot Interaction , 2008, ISER.

[50]  Donald A. Norman,et al.  Attention to Action , 1986 .

[51]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[52]  Rachid Alami,et al.  Situation assessment for human-robot interactive object manipulation , 2011, 2011 RO-MAN.