Mutual trust-based subtask allocation for human–robot collaboration in flexible lightweight assembly in manufacturing

Abstract A human–robot hybrid cell is developed for flexible assembly in manufacturing through the collaboration between a human and a robot. The selected task is to assemble a few LEGO blocks (parts) into a final product following specified sequence and instructions. The task is divided into several subtasks. A two-level feedforward optimization strategy is developed that determines optimum subtask allocation between the human and the robot before the assembly starts. Human's trust in robot and robot's trust in human are considered, computational models of the trust are derived and real-time trust measurement and display methods are developed. A feedback approach is integrated into the feedforward subtask allocation in the form of subtask re-allocation if trust levels reduce to below specified thresholds. It is hypothesized that subtask re-allocation may help regain trust and maintain satisfactory performance. Experiment results prove that (i) the integrated (feedforward + feedback) optimum subtask allocation is effective to maintain satisfactory trust levels of human and robot that result in satisfactory human–robot interactions (HRI) and assembly performance, and (ii) consideration of two-way trust (human's trust in robot and robot's trust in human) produces better HRI and assembly performance than that produced when one-way trust (human's trust in robot) or no trust is considered.

[1]  Alan R. Dennis,et al.  Individual Swift Trust and Knowledge-Based Trust in Face-to-Face and Virtual Team Members , 2009, J. Manag. Inf. Syst..

[2]  Hajime Asama,et al.  Dynamical task allocation and reallocation based on body expansion behavior for multi-robot coordination system , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  N. L. Chervany,et al.  Initial Trust Formation in New Organizational Relationships , 1998 .

[5]  J. M. Rohani,et al.  Relationship between working postures and MSD in different body regions among electronics assembly workers in Malaysia , 2013, 2013 IEEE International Conference on Industrial Engineering and Engineering Management.

[6]  Silvano Martello,et al.  Jenő Egerváry: from the origins of the Hungarian algorithm to satellite communication , 2010, Central Eur. J. Oper. Res..

[7]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[8]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[9]  Feng Duan,et al.  Human-robot collaboration in cellular manufacturing: Design and development , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Hao Ding,et al.  Optimized task distribution for industrial assembly in mixed human-robot environments - Case study on IO module assembly , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[11]  Julie A. Shah,et al.  Fast Scheduling of Multi-Robot Teams with Temporospatial Constraints , 2013, Robotics: Science and Systems.

[12]  S. M. Mizanoor Rahman,et al.  Evaluating and Benchmarking the Interactions between a Humanoid Robot and a Virtual Human for a Real-World Social Task , 2013, IAIT.

[13]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[14]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  M. Baily,et al.  US Manufacturing: Understanding Its Past and Its Potential Future , 2014 .

[16]  Fang Xu,et al.  Industrial robot base assembly based on improved Hough transform of circle detection algorithm , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[17]  Guy Hoffman,et al.  Evaluating Fluency in Human–Robot Collaboration , 2019, IEEE Transactions on Human-Machine Systems.

[18]  Ayanna M. Howard.  Role allocation in human-robot interaction schemes for mission scenario execution , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[19]  Sarvapali D. Ramchurn,et al.  Trust-Based Mechanisms for Robust and Efficient Task Allocation in the Presence of Execution Uncertainty , 2009, J. Artif. Intell. Res..

[20]  Ferdinando Cannella,et al.  Optimal Subtask Allocation for Human and Robot Collaboration Within Hybrid Assembly System , 2014, IEEE Transactions on Automation Science and Engineering.

[21]  Hamed Saeidi,et al.  Modeling and Control of Trust in Human and Robot Collaborative Manufacturing , 2014, AAAI Spring Symposia.

[22]  Rahul Rai,et al.  Autonomous task assignment of multiple operators for human robot interaction , 2013, 2013 American Control Conference.

[23]  Sami Haddadin,et al.  A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes , 2017, ICRA 2017.

[24]  Rocco J. Perla,et al.  Ten Common Misunderstandings, Misconceptions, Persistent Myths and Urban Legends about Likert Scales and Likert Response Formats and their Antidotes , 2007 .

[25]  Karon E. MacLean,et al.  Gestures for industry Intuitive human-robot communication from human observation , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[26]  Yue Wang,et al.  Trust-Based Optimal Subtask Allocation and Model Predictive Control for Human-Robot Collaborative Assembly in Manufacturing , 2015, HRI 2015.

[27]  Sandra Hirche,et al.  Investigating Human-Human Approach and Hand-Over , 2009, Human Centered Robot Systems, Cognition, Interaction, Technology.

[28]  Björn Matthias,et al.  Safety of Industrial Robots: From Conventional to Collaborative Applications , 2012, ROBOTIK.

[29]  Dylan A. Shell,et al.  Optimal Market-based Multi-Robot Task Allocation via Strategic Pricing , 2013, Robotics: Science and Systems.

[30]  Simon Cooper,et al.  Measuring situation awareness in emergency settings: a systematic review of tools and outcomes , 2013, Open access emergency medicine : OAEM.

[31]  Maja J. Mataric,et al.  Role-based coordinating communication for effective human-robot task collaborations , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[32]  Vivek K. Sunnapwar,et al.  Improving the performance of assembly line: Review with case study , 2015, 2015 International Conference on Nascent Technologies in the Engineering Field (ICNTE).

[33]  Candace L. Sidner,et al.  Explorations in engagement for humans and robots , 2005, Artif. Intell..

[34]  B. K. Ghosh,et al.  A systems approach to task allocation of human-robot interaction in manufacturing , 1986 .

[35]  Rajendra Patel,et al.  Enabling robots in small-part assembly lines: The "ROSETTA approach" - an industrial perspective , 2012, ROBOTIK.

[36]  Yangmin Li,et al.  Parameters identification and vibration control for modular manipulators , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[37]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[38]  Taixiong Zheng,et al.  Research on Optimized Multiple Robots Path Planning and Task Allocation Approach , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[39]  Allison Sauppé,et al.  Effective Task Training Strategies for Instructional Robots , 2014, Robotics: Science and Systems.

[40]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[41]  Akiko Takeda,et al.  Optimizing over coherent risk measures and non-convexities: a robust mixed integer optimization approach , 2015, Comput. Optim. Appl..

[42]  David Bergman,et al.  Discrete Optimization with Decision Diagrams , 2016, INFORMS J. Comput..

[43]  Stefanos Nikolaidis,et al.  Optimization of Temporal Dynamics for Adaptive Human-Robot Interaction in Assembly Manufacturing , 2012, Robotics: Science and Systems.

[44]  Lynne E. Parker,et al.  A Complete Methodology for Generating Multi-Robot Task Solutions using ASyMTRe-D and Market-Based Task Allocation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[45]  S Lewandowsky,et al.  The dynamics of trust: comparing humans to automation. , 2000, Journal of experimental psychology. Applied.

[46]  Aaron Steinfeld,et al.  Effects of blame on trust in human robot interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.