An ontology to enable optimized task partitioning in human-robot collaboration for warehouse kitting operations

Collaborative teams of human operators and mobile ground robots are becoming popular in manufacturing plants to assist humans with a lot of the repetitive tasks such as the packing of related objects into different units, an operation known as kitting. In this paper, we present an ontology to provide a unified representation of all kitting-related tasks, which are decomposed into atomic actions that are either computational involving sensing, perception, planning, and control, or physical involving actuation and manipulation. The ontology is then used in a stochastic integer linear program for optimum partitioning of the atomic tasks between the robots and humans. Preliminary experiments on a single robot, single human case yield promising results where the kitting operations are completed with lower durations and manipulation failure rates using human-robot partnership versus just the human or only the robot. This success is achieved by the robot seeking human assistance for visual perception tasks while performing the other tasks primarily on its own.

[1]  Maki K. Habib,et al.  Applied ontologies and standards for service robots , 2013, Robotics Auton. Syst..

[2]  Tsung-Hsien Yang,et al.  A Service-Oriented Framework for the Development of Home Robots , 2013 .

[3]  Rosario Girardi,et al.  A Process for Extracting Non-Taxonomic Relationships of Ontologies from Text , 2011, Intell. Inf. Manag..

[4]  Paolo Fiorini,et al.  EuRoSurge Workflow: From ontology to surgical task execution , 2013 .

[5]  Alin Albu-Schäffer,et al.  Towards the Robotic Co-Worker , 2009, ISRR.

[6]  Stefanos Nikolaidis,et al.  Optimization of Temporal Dynamics for Adaptive Human-Robot Interaction in Assembly Manufacturing , 2012, Robotics: Science and Systems.

[7]  Clint Heyer.  Human-robot interaction and future industrial robotics applications , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  James C. Boerkoel,et al.  Towards control and sensing for an autonomous mobile robotic assistant navigating assembly lines , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Nicholas Roy,et al.  Comparing the Performance of Expert User Heuristics and an Integer Linear Program in Aircraft Carrier Deck Operations , 2014, IEEE Transactions on Cybernetics.

[10]  Carlos Morato,et al.  Toward Safe Human Robot Collaboration by Using Multiple Kinects Based Real-Time Human Tracking , 2014, J. Comput. Inf. Sci. Eng..

[11]  Tamas Haidegger,et al.  Extensions to the core ontology for robotics and automation , 2015 .

[12]  Anders Robertsson,et al.  On the integration of skilled robot motions for productivity in manufacturing , 2011, 2011 IEEE International Symposium on Assembly and Manufacturing (ISAM).

[13]  Julie A. Shah,et al.  Decision-making authority, team efficiency and human worker satisfaction in mixed human–robot teams , 2015, Auton. Robots.

[14]  Renan Maffei,et al.  Exploring the IEEE ontology for robotics and automation for heterogeneous agent interaction , 2015 .

[15]  Przemyslaw A. Lasota,et al.  Toward safe close-proximity human-robot interaction with standard industrial robots , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[16]  Sébastien Gérard,et al.  Towards a core ontology for robotics and automation , 2013, Robotics Auton. Syst..

[17]  Il Hong Suh,et al.  Ontology-based multi-layered robot knowledge framework (OMRKF) for robot intelligence , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  John M. Wilson,et al.  Introduction to Stochastic Programming , 1998, J. Oper. Res. Soc..

[19]  Julie A. Shah,et al.  Fast Scheduling of Multi-Robot Teams with Temporospatial Constraints , 2013, Robotics: Science and Systems.

[20]  Il Hong Suh,et al.  Ontology-Based Unified Robot Knowledge for Service Robots in Indoor Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[21]  R. Lougee-Heimer,et al.  The Common Optimization INterface for Operations Research: Promoting open-source software in the operations research community , 2003 .

[22]  David Hsu,et al.  Motion planning under uncertainty for robotic tasks with long time horizons , 2010, Int. J. Robotics Res..

[23]  Ivan Lundberg,et al.  Safety of collaborative industrial robots: Certification possibilities for a collaborative assembly robot concept , 2011, 2011 IEEE International Symposium on Assembly and Manufacturing (ISAM).

[24]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Carlos Morato,et al.  A Framework for Hybrid Cells That Support Safe and Efficient Human-Robot Collaboration in Assembly Operations , 2014 .

[26]  Jacek Malec,et al.  Knowledge-based instruction of manipulation tasks for industrial robotics , 2015 .