Flexible human-robot cooperation models for assisted shop-floor tasks

The Industry 4.0 paradigm emphasizes the crucial benefits that collaborative robots, i.e., robots able to work alongside and together with humans, could bring to the whole production process. In this context, an enabling technology yet unreached is the design of flexible robots able to deal at all levels with humans' intrinsic variability, which is not only a necessary element for a comfortable working experience for the person but also a precious capability for efficiently dealing with unexpected events. In this paper, a sensing, representation, planning and control architecture for flexible human-robot cooperation, referred to as FlexHRC, is proposed. FlexHRC relies on wearable sensors for human action recognition, AND/OR graphs for the representation of and reasoning upon cooperation models, and a Task Priority framework to decouple action planning from robot motion planning and control.

[1]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[2]  Janeen D. Loehr,et al.  Joint Action: From Perception-Action Links to Shared Representations , 2013 .

[3]  Karon E. MacLean,et al.  Gestures for industry Intuitive human-robot communication from human observation , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Sotiris Makris,et al.  Augmented reality system for operator support in human–robot collaborative assembly , 2016 .

[5]  Fulvio Mastrogiovanni,et al.  Semantic-Aware Real-Time Scheduling in Robotics , 2013, IEEE Transactions on Robotics.

[6]  Susan Goldin-Meadow,et al.  A word in the hand: action, gesture and mental representation in humans and non-human primates , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  Pieter Abbeel,et al.  Combined task and motion planning through an extensible planner-independent interface layer , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Manfred Tscheligi,et al.  Working together with industrial robots: Experiencing robots in a production environment , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[9]  Arthur C. Sanderson,et al.  Task planning for robotic manipulation in space applications , 1988 .

[10]  Jitendra Malik,et al.  Recurrent Network Models for Human Dynamics , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Matteo Saveriano,et al.  Incremental kinesthetic teaching of end-effector and null-space motion primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Alessandro Saffiotti,et al.  Using Fuzzy Logic to Enhance Classification of Human Motion Primitives , 2014, IPMU.

[13]  Ferdinando Cannella,et al.  Optimal Subtask Allocation for Human and Robot Collaboration Within Hybrid Assembly System , 2014, IEEE Transactions on Automation Science and Engineering.

[14]  B. Bertenthal,et al.  Origins and early development of perception, action, and representation. , 1996, Annual review of psychology.

[15]  Cordula Vesper,et al.  A minimal architecture for joint action , 2010, Neural Networks.

[16]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[17]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[18]  Fulvio Mastrogiovanni,et al.  A Software Architecture for Object Perception and Semantic Representation , 2015, AIRO@AI*IA.

[19]  M. Hagele,et al.  rob@work: Robot assistant in industrial environments , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[20]  Sami Haddadin,et al.  A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes , 2017, ICRA 2017.

[21]  Ivan Lundberg,et al.  Robot concept for scalable, flexible assembly automation: A technology study on a harmless dual-armed robot , 2011, 2011 IEEE International Symposium on Assembly and Manufacturing (ISAM).

[22]  Tullio Vernazza,et al.  Analysis of human behavior recognition algorithms based on acceleration data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[23]  Sami Haddadin,et al.  An Artificial Robot Nervous System To Teach Robots How To Feel Pain And Reflexively React To Potentially Damaging Contacts , 2017, IEEE Robotics and Automation Letters.

[24]  Manuel Lopes,et al.  Relational activity processes for modeling concurrent cooperation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Claus Lenz,et al.  Context-aware human-robot collaboration as a basis for future cognitive factories , 2011 .

[26]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Alessandro Saffiotti,et al.  Scene Learning, Recognition and Similarity Detection in a Fuzzy Ontology via Human Examples , 2017, AIRO@AI*IA.

[28]  Jitendra Malik,et al.  Learning to Poke by Poking: Experiential Learning of Intuitive Physics , 2016, NIPS.

[29]  Aaron F. Bobick,et al.  Anticipating human actions for collaboration in the presence of task and sensor uncertainty , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Klaus Bengler,et al.  Directly or on detours? How should industrial robots approximate humans? , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[31]  Giuseppe Casalino,et al.  A Novel Practical Technique to Integrate Inequality Control Objectives and Task Transitions in Priority Based Control , 2016, J. Intell. Robotic Syst..

[32]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[33]  Alois Knoll,et al.  Increasing efficiency in robot-supported assemblies through predictive mechanisms: An experimental evaluation , 2013, 2013 IEEE RO-MAN.

[34]  Anca D. Dragan,et al.  Cooperative Inverse Reinforcement Learning , 2016, NIPS.

[35]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[36]  Sotiris Makris,et al.  Design Considerations for Safe Human-robot Collaborative Workplaces , 2015 .

[37]  Brian Scassellati,et al.  Autonomously constructing hierarchical task networks for planning and human-robot collaboration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[38]  Séverin Lemaignan,et al.  Artificial cognition for social human-robot interaction: An implementation , 2017, Artif. Intell..

[39]  D. DeSteno,et al.  The rhythm of joint action: Synchrony promotes cooperative ability , 2010 .

[40]  Martin Buss,et al.  Human-Robot Collaboration: a Survey , 2008, Int. J. Humanoid Robotics.

[41]  Stefano Chiaverini,et al.  Singularity-robust task-priority redundancy resolution for real-time kinematic control of robot manipulators , 1997, IEEE Trans. Robotics Autom..

[42]  Lorenzo Molinari Tosatti,et al.  Safe Human-Robot Cooperation in an Industrial Environment , 2013 .

[44]  Kristin Ytterstad Pettersen,et al.  Set-Based Tasks within the Singularity-Robust Multiple Task-Priority Inverse Kinematics Framework: General Formulation, Stability Analysis, and Experimental Results , 2016, Front. Robot. AI.