An anthropomorphic soft skeleton hand exploiting conditional models for piano playing

Conditional models provide a method of achieving varying behaviors by using hybrid and passive mechanical structures. The development of robotic manipulators and hands that show dexterity, adaptability, and subtle behavior comparable to human hands is an unsolved research challenge. In this article, we considered the passive dynamics of mechanically complex systems, such as a skeleton hand, as an approach to improving adaptability, dexterity, and richness of behavioral diversity of such robotic manipulators. With the use of state-of-the-art multimaterial three-dimensional printing technologies, it is possible to design and construct complex passive structures, namely, a complex anthropomorphic skeleton hand that shows anisotropic mechanical stiffness. We introduce a concept, termed the “conditional model,” that exploits the anisotropic stiffness of complex soft-rigid hybrid systems. In this approach, the physical configuration, environment conditions, and conditional actuation (applied actuation) resulted in an observable conditional model, allowing joint actuation through passivity-based dynamic interactions. The conditional model approach allowed the physical configuration and actuation to be altered, enabling a single skeleton hand to perform three different phrases of piano music with varying styles and forms and facilitating improved dynamic behaviors and interactions with the piano over those achievable with a rigid end effector.

[1]  Kyung-Soo Kim,et al.  Designing Anthropomorphic Robot Hand With Active Dual-Mode Twisted String Actuation Mechanism and Tiny Tension Sensors , 2017, IEEE Robotics and Automation Letters.

[2]  H. Harry Asada,et al.  Nonlinear Feedback Control of a Gravity-Assisted Underactuated Manipulator With Application to Aircraft Assembly , 2009, IEEE Transactions on Robotics.

[3]  Jorge Angeles,et al.  Singularity analysis of three-legged parallel robots based on passive-joint velocities , 2001, IEEE Trans. Robotics Autom..

[4]  Cecilia Laschi,et al.  Soft robotics: a bioinspired evolution in robotics. , 2013, Trends in biotechnology.

[5]  Filip Ilievski,et al.  Soft robotics for chemists. , 2011, Angewandte Chemie.

[6]  J. F. Soechting,et al.  Hand kinematics of piano playing. , 2011, Journal of neurophysiology.

[7]  D. Burke,et al.  Responses to passive movement of receptors in joint, skin and muscle of the human hand. , 1988, The Journal of physiology.

[8]  Shigeki Sugano,et al.  WABOT-2: Autonomous robot with dexterous finger-arm--Finger-arm coordination control in keyboard performance , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[9]  Frédéric Boyer,et al.  Locomotion Dynamics for Bio-inspired Robots with Soft Appendages: Application to Flapping Flight and Passive Swimming , 2017, J. Nonlinear Sci..

[10]  Yen-Fang Li,et al.  Intelligent algorithm for music playing robot — Applied to the anthropomorphic piano robot control , 2014, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE).

[11]  L. M. Myers,et al.  The axes of rotation of the thumb interphalangeal and metacarpophalangeal joints. , 1995, Clinical orthopaedics and related research.

[12]  Robert J. Wood,et al.  A 3D-printed, functionally graded soft robot powered by combustion , 2015, Science.

[13]  Siddhartha S. Srinivasa,et al.  Autonomous manipulation with a general-purpose simple hand , 2011, Int. J. Robotics Res..

[14]  Ian D. Walker,et al.  Soft robotics: Biological inspiration, state of the art, and future research , 2008 .

[15]  Manuel G. Catalano,et al.  From Soft to Adaptive Synergies: The Pisa/IIT SoftHand , 2016, Human and Robot Hands.

[16]  Kai-Nan An,et al.  A simulating analysis of the effects of increased joint stiffness on muscle loading in a thumb , 2009, Biomedical engineering online.

[17]  Shuichi Wakimoto,et al.  Design of a variable-stiffness robotic hand using pneumatic soft rubber actuators , 2011 .

[18]  Chandana Paul,et al.  The Tendon Network of the Fingers Performs Anatomical Computation at a Macroscopic Scale , 2007, IEEE Transactions on Biomedical Engineering.

[19]  Robert J. Wood,et al.  An integrated design and fabrication strategy for entirely soft, autonomous robots , 2016, Nature.

[20]  Nicholas G. Dagalakis,et al.  Analysis and design of parallel mechanisms with flexure joints , 2004, IEEE Transactions on Robotics.

[21]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[22]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[23]  Gionata Salvietti,et al.  Replicating Human Hand Synergies Onto Robotic Hands: A Review on Software and Hardware Strategies , 2018, Front. Neurorobot..

[24]  Archana B. Patankar,et al.  Piano playing robot , 2016, 2016 International Conference on Internet of Things and Applications (IOTA).

[25]  Stéphane Doncieux,et al.  Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study , 2012, Evolutionary Computation.

[26]  Giorgio Grioli,et al.  Variable Stiffness Actuators: Review on Design and Components , 2016, IEEE/ASME Transactions on Mechatronics.

[27]  Mark R. Cutkosky,et al.  Selectively compliant underactuated hand for mobile manipulation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  Fumiya Iida,et al.  Soft Manipulators and Grippers: A Review , 2016, Front. Robot. AI.

[29]  G. Hirzinger,et al.  A new variable stiffness design: Matching requirements of the next robot generation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[30]  R. Pfeifer,et al.  Cognition from the bottom up: on biological inspiration, body morphology, and soft materials , 2014, Trends in Cognitive Sciences.

[31]  Antonio Bicchi,et al.  Fast and "soft-arm" tactics [robot arm design] , 2004, IEEE Robotics & Automation Magazine.

[32]  A. Ijspeert,et al.  From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord Model , 2007, Science.

[33]  Russ Tedrake,et al.  Efficient Bipedal Robots Based on Passive-Dynamic Walkers , 2005, Science.

[34]  T. Nanayakkara,et al.  Soft Robotics Technologies to Address Shortcomings in Today ’ s Minimally Invasive Surgery : The STIFF-FLOP Approach , 2014 .

[35]  Rogelio Lozano,et al.  Energy based control of the Pendubot , 2000, IEEE Trans. Autom. Control..

[36]  Yen-Fang Li,et al.  Electronic piano playing robot , 2010, 2010 International Symposium on Computer, Communication, Control and Automation (3CA).

[37]  Takuya Umedachi,et al.  Highly deformable 3-D printed soft robot generating inching and crawling locomotions with variable friction legs , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Shashank Priya,et al.  Design and implementation of a dexterous anthropomorphic robotic typing (DART) hand , 2011 .

[39]  Y. Matsuoka,et al.  Design of an anthropomorphic robotic finger system with biomimetic artificial joints , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[40]  Nikolaos G. Tsagarakis,et al.  VSA-CubeBot: A modular variable stiffness platform for multiple degrees of freedom robots , 2011, 2011 IEEE International Conference on Robotics and Automation.

[41]  Ioannis M. Rekleitis,et al.  The Avatar Project , 2008, IEEE Robotics & Automation Magazine.

[42]  CianchettiMatteo,et al.  Soft Robotics Technologies to Address Shortcomings in Today's Minimally Invasive Surgery: The STIFF-FLOP Approach , 2014 .

[43]  G. Whitesides Soft Robotics. , 2018, Angewandte Chemie.

[44]  Matteo Bianchi,et al.  Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands. , 2016, Physics of life reviews.

[45]  Dan Zhang,et al.  Design and analysis of a piano playing robot , 2009, 2009 International Conference on Information and Automation.

[46]  Alin Albu-Schäffer,et al.  Optimal control for exploiting the natural dynamics of Variable Stiffness robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[47]  Sung-Hyuk Song,et al.  Smart soft composite: An integrated 3D soft morphing structure using bend-twist coupling of anisotropic materials , 2012 .

[48]  Susumu Tachi,et al.  Position control of manipulator with passive joints using dynamic coupling , 1991, IEEE Trans. Robotics Autom..

[49]  Takeshi Hatanaka,et al.  Passivity-based control of robots: Historical perspective and contemporary issues , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[50]  D. J. White,et al.  Measurement Of Joint Motion A Guide To Goniometry , 2016 .

[51]  M. Muhlenhaupt Measurement of Joint Motion: A Guide to Goniometry , 1986 .

[52]  Ruzena Bajcsy,et al.  A medium-complexity compliant end effector , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[53]  Hong Liu,et al.  DLR hand II: experiments and experience with an anthropomorphic hand , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[54]  Hua Deng,et al.  Humanoid design of mechanical fingers using a motion coupling and shape-adaptive linkage mechanism , 2018 .

[55]  J. Lewis,et al.  Printing soft matter in three dimensions , 2016, Nature.

[56]  Taylor Cl,et al.  The anatomy and mechanics of the human hand. , 1955 .

[57]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[58]  Mariangela Manti,et al.  Stiffening in Soft Robotics: A Review of the State of the Art , 2016, IEEE Robotics & Automation Magazine.

[59]  Aaron M. Dollar,et al.  Open-Loop Precision Grasping With Underactuated Hands Inspired by a Human Manipulation Strategy , 2013, IEEE Transactions on Automation Science and Engineering.

[60]  Oliver Brock,et al.  Exploitation of environmental constraints in human and robotic grasping , 2015, Int. J. Robotics Res..

[61]  R. Brent Gillespie,et al.  Characterizing the Feel of the Piano Action , 2011, Computer Music Journal.

[62]  Patrick van der Smagt,et al.  Human hand modelling: kinematics, dynamics, applications , 2012, Biological Cybernetics.

[63]  Fumiya Iida,et al.  The challenges ahead for bio-inspired 'soft' robotics , 2012, CACM.

[64]  Gianluca Palli,et al.  Robust control of robots with variable joint stiffness , 2009, 2009 International Conference on Advanced Robotics.

[65]  Giuseppe Averta,et al.  Postural Hand Synergies during Environmental Constraint Exploitation , 2017, Front. Neurorobot..

[66]  Kaspar Althoefer,et al.  Design of a variable stiffness flexible manipulator with composite granular jamming and membrane coupling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  B M Hillberry,et al.  Finger joint force minimization in pianists using optimization techniques. , 1993, Journal of biomechanics.

[68]  G. Lauder,et al.  Passive propulsion in vortex wakes , 2006, Journal of Fluid Mechanics.

[69]  Gerd Hirzinger,et al.  The thumb: guidelines for a robotic design , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  J. F. Soechting,et al.  Anticipatory and sequential motor control in piano playing , 1997, Experimental Brain Research.

[71]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[72]  Allison M. Okamura,et al.  Artificial Tactile Sensing of Position and Slip Speed by Exploiting Geometrical Features , 2015, IEEE/ASME Transactions on Mechatronics.

[73]  Manuel G. Catalano,et al.  Adaptive synergies: An approach to the design of under-actuated robotic hands , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[74]  Robert D. Howe,et al.  Towards a design optimization method for reducing the mechanical complexity of underactuated robotic hands , 2012, 2012 IEEE International Conference on Robotics and Automation.

[75]  B Mazzolai,et al.  An octopus-bioinspired solution to movement and manipulation for soft robots , 2011, Bioinspiration & biomimetics.