Prototyping proactive and adaptive techniques for human-robot collaboration in manufacturing using virtual reality

Abstract Human-Robot Interaction (HRI) has emerged in recent years as a need for common collaborative execution of manufacturing tasks. This work examines two types of techniques of safe collaboration that do not interrupt the flow of collaboration as far as possible, namely proactive and adaptive. The former are materialised using audio and visual cognitive aids, which the user receives as dynamic stimuli in real time during collaboration, and are aimed at information enrichment of the latter. Adaptive techniques investigated refer to the robot; according to the first one of them the robot decelerates when a forthcoming contact with the user is traced, whilst according to the second one the robot retracts and moves to the final destination via a modified, safe trajectory, so as to avoid the human. The effectiveness as well as the activation criteria of the above techniques are investigated in order to avoid possible pointless or premature activation. Such investigation was implemented in a prototype highly interactive and immersive Virtual Environment (VE), in the framework of H-R collaborative hand lay-up process of carbon fabric in an industrial workcell. User tests were conducted, in which both subjective metrics of user satisfaction and performance metrics of the collaboration (task completion duration, robot mean velocity, number of detected human-robot collisions etc.) After statistical processing, results do verify the effectiveness of safe collaboration techniques as well as their acceptability by the user, showing that collaboration performance is affected to a different extent.

[1]  Amine Chellali,et al.  Étude des interactions homme-homme pour l'élaboration du référentiel commun dans les environnements virtuels collaboratifs. , 2009 .

[2]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[3]  Andrea Maria Zanchettin,et al.  Safety in human-robot collaborative manufacturing environments: Metrics and control , 2016, IEEE Transactions on Automation Science and Engineering.

[4]  Ming Wang,et al.  A method of human-robot collaboration for grinding of workpieces , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[5]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[6]  Zhenqi Zhu,et al.  Errors and Corrections of Robotics Standard ANSI/RIA R15.05-1-1990: Industrial Robots and Robot Systems Point to Point and Static Performance Characteristics—Evaluation , 2002 .

[7]  Lihui Wang,et al.  Collaborative robot monitoring and control for enhanced sustainability , 2015 .

[8]  Antonio Bicchi,et al.  On making robots understand safety: Embedding injury knowledge into control , 2012, Int. J. Robotics Res..

[9]  Rolf Dieter Schraft,et al.  PowerMate – A Safe and Intuitive Robot Assistant for Handling and Assembly Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  André Crosnier,et al.  Collaborative manufacturing with physical human–robot interaction , 2016 .

[11]  Koji Ikuta,et al.  Safety Evaluation Method of Design and Control for Human-Care Robots , 2003, Int. J. Robotics Res..

[12]  Ruediger Dillmann,et al.  Sharing skills: using augmented reality for human-robot collaboration , 2004, IS&T/SPIE Electronic Imaging.

[13]  Ho Chit Siu,et al.  Comparative Performance of Human and Mobile Robotic Assistants in Collaborative Fetch-and-Deliver Tasks , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Christopher M. Schlick,et al.  Embedded Augmented Reality Training System for Dynamic Human-Robot Cooperation , 2009 .

[15]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[16]  J. Geoffrey Chase,et al.  Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design , 2008 .

[17]  Andrea Maria Zanchettin,et al.  Integration of perception, control and injury knowledge for safe human-robot interaction , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Vincent Padois,et al.  Control of robots sharing their workspace with humans: An energetic approach to safety , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Alin Albu-Schäffer,et al.  Towards the Robotic Co-Worker , 2009, ISRR.

[20]  George-Christopher Vosniakos,et al.  Modelling simple human-robot collaborative manufacturing tasks in interactive virtual environments , 2016, VRIC.

[21]  Siam Charoenseang,et al.  Human-Robot Collaboration with Augmented Reality , 2011, HCI.

[22]  Roland Menassa,et al.  Levels of human and robot collaboration for automotive manufacturing , 2012, PerMIS.

[23]  M. Hagele,et al.  rob@work: Robot assistant in industrial environments , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[24]  Philippe Fuchs,et al.  Assessing the acceptability of human-robot co-presence on assembly lines: A comparison between actual situations and their virtual reality counterparts , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[25]  XiaoQi Chen,et al.  Evaluating the Augmented Reality Human-Robot Collaboration System , 2008 .

[26]  George-Christopher Vosniakos,et al.  Effectiveness and acceptability of a virtual environment for assessing human–robot collaboration in manufacturing , 2017 .

[27]  Cynthia Breazeal,et al.  Effects of anticipatory action on human-robot teamwork: Efficiency, fluency, and perception of team , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Soh-Khim Ong,et al.  A novel augmented reality-based interface for robot path planning , 2014 .

[29]  Vincent G. Duffy,et al.  Perception of safe robot speed in virtual and real industrial environments , 2006 .

[30]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[31]  Christopher D. Wickens,et al.  Situation Awareness: Review of Mica Endsley's 1995 Articles on Situation Awareness Theory and Measurement , 2008, Hum. Factors.

[32]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[33]  Oussama Khatib,et al.  Mobile manipulation: The robotic assistant , 1999, Robotics Auton. Syst..