Multiobjective Optimization for Stiffness and Position Control in a Soft Robot Arm Module

The central concept of this letter is to develop an assistive manipulator that can automate the bathing task for elderly citizens. We propose to exploit principles of soft robotic technologies to design and control a compliant system to ensure safe human–robot interaction, a primary requirement for the task. The overall system is intended to be modular with a proximal segment that provides structural integrity to overcome gravitational challenges and a distal segment to perform the main bathing activities. The focus of this letter is on the design and control of the latter module. The design comprises of alternating tendons and pneumatics in a radial arrangement, which enables elongation, contraction, and omnidirectional bending. Additionally, a synergetic coactivation of cables and tendons in a given configuration allows for stiffness modulation, which is necessary to facilitate washing and scrubbing. The novelty of the work is twofold: 1) Three base cases of antagonistic actuation are identified that enable stiffness variation. Each category is then experimentally characterized by the application of an external force that imposes a linear displacement at the tip in both axial and lateral directions. 2) The development of a novel algorithm based on cooperative multiagent reinforcement learning that simultaneously optimizes stiffness and position. The results highlight the effectiveness of the design and control to contribute toward the development of the assistive device.

[1]  Matteo Cianchetti,et al.  A Multiagent Reinforcement Learning approach for inverse kinematics of high dimensional manipulators with precision positioning , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[2]  Peter Stone,et al.  Scaling Reinforcement Learning toward RoboCup Soccer , 2001, ICML.

[3]  Tamim Asfour,et al.  The KIT whole-body human motion database , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[4]  Matteo Cianchetti,et al.  Soft robotics: Technologies and systems pushing the boundaries of robot abilities , 2016, Science Robotics.

[5]  Shimon Whiteson,et al.  A Survey of Multi-Objective Sequential Decision-Making , 2013, J. Artif. Intell. Res..

[6]  Craig Boutilier,et al.  The Dynamics of Reinforcement Learning in Cooperative Multiagent Systems , 1998, AAAI/IAAI.

[7]  Thomas Bock,et al.  Full paper: Towards robotic assisted hygienic services: Concept for assisting and automating daily activities in the bathroom , 2012 .

[8]  Arianna Menciassi,et al.  A Soft Modular Manipulator for Minimally Invasive Surgery: Design and Characterization of a Single Module , 2016, IEEE Transactions on Robotics.

[9]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Kaspar Althoefer,et al.  Tendon-Based Stiffening for a Pneumatically Actuated Soft Manipulator , 2016, IEEE Robotics and Automation Letters.

[11]  Robert Babuska,et al.  Experience Replay for Real-Time Reinforcement Learning Control , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Matteo Cianchetti,et al.  Point-to-point motion controller for soft robotic manipulators , 2016, 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[13]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[14]  Guy Immega,et al.  The KSI tentacle manipulator , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[15]  Ian D. Walker,et al.  Design and implementation of a multi-section continuum robot: Air-Octor , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Robert H. Crites,et al.  Multiagent reinforcement learning in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[17]  Alexander Verl,et al.  The Bionic Handling Assistant: a success story of additive manufacturing , 2011 .

[18]  Leemon C. Baird,et al.  Residual Algorithms: Reinforcement Learning with Function Approximation , 1995, ICML.

[19]  Eliane de Sousa Leite,et al.  Influence of Assistive Technology for the Maintenance of the Functionality of Elderly People: an Integrative Review , 2016 .

[20]  Sandra Bedaf,et al.  Can a Service Robot Which Supports Independent Living of Older People Disobey a Command? The Views of Older People, Informal Carers and Professional Caregivers on the Acceptability of Robots , 2016, Int. J. Soc. Robotics.

[21]  Mariangela Manti,et al.  Towards the development of a soft manipulator as an assistive robot for personal care of elderly people , 2017 .

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[23]  Mahesan Niranjan,et al.  On-line Q-learning using connectionist systems , 1994 .

[24]  Mariangela Manti,et al.  Soft assistive robot for personal care of elderly people , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[25]  Matteo Cianchetti,et al.  Soft Robotics: New Perspectives for Robot Bodyware and Control , 2014, Front. Bioeng. Biotechnol..

[26]  Arianna Menciassi,et al.  STIFF-FLOP surgical manipulator: Mechanical design and experimental characterization of the single module , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Haibin Yin,et al.  Stiffness characteristics of soft finger with embedded SMA fibers , 2017 .

[28]  Vishesh Vikas,et al.  Model-free control framework for multi-limb soft robots , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).