Online Body Schema Adaptation through Cost-Sensitive Active Learning

Humanoid robots have complex bodies and kinematic chains with several Degrees-of-Freedom (DoF) which are difficult to model. Learning the parameters of a kinematic model can be achieved by observing the position of the robot links during prospective motions and minimising the prediction errors. This work proposes a movement efficient approach for estimating online the body-schema of a humanoid robot arm in the form of Denavit-Hartenberg (DH) parameters. A costsensitive active learning approach based on the A-Optimality criterion is used to select optimal joint configurations. The chosen joint configurations simultaneously minimise the error in the estimation of the body schema and minimise the movement between samples. This reduces energy consumption, along with mechanical fatigue and wear, while not compromising the learning accuracy. The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator. The hand pose is measured with a single camera via markers placed in the palm and back of the robot’s hand. A nonparametric occlusion model is proposed to avoid choosing joint configurations where the markers are not visible, thus preventing worthless attempts. The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.

[1]  Luiz Paulo Lopes Fávero,et al.  Estimation , 2019, Data Science for Business and Decision Making.

[2]  Takamitsu Matsubara,et al.  Active tactile exploration with uncertainty and travel cost for fast shape estimation of unknown objects , 2017, Robotics Auton. Syst..

[3]  Alexandre Bernardino,et al.  Incremental adaptation of a robot body schema based on touch events , 2018, 2018 Joint IEEE 8th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[4]  Matej Hoffmann,et al.  Robot Self-Calibration Using Multiple Kinematic Chains—A Simulation Study on the iCub Humanoid Robot , 2018, IEEE Robotics and Automation Letters.

[5]  Yiannis Demiris,et al.  Active Learning of Object and Body Models with Time Constraints on a Humanoid Robot , 2016, IEEE Transactions on Cognitive and Developmental Systems.

[6]  Tony J. Dodd,et al.  Active sensorimotor control for tactile exploration , 2017, Robotics Auton. Syst..

[7]  A. V. D. van der Meer Keeping the arm in the limelight: advanced visual control of arm movements in neonates. , 1997, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[8]  Alexandre Bernardino,et al.  Online Body Schema Adaptation Based on Internal Mental Simulation and Multisensory Feedback , 2016, Front. Robot. AI.

[9]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[10]  Angelo Cangelosi,et al.  An open-source simulator for cognitive robotics research: the prototype of the iCub humanoid robot simulator , 2008, PerMIS.

[11]  Manuel Lopes,et al.  Learning grasping affordances from local visual descriptors , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[12]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[13]  Ralf Dörner,et al.  Accuracy in optical tracking with fiducial markers: an accuracy function for ARToolKit , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[14]  Tamim Asfour,et al.  Active Tactile Exploration Based on Cost-Aware Information Gain Maximization , 2018, Int. J. Humanoid Robotics.

[15]  Reiner Sebastian Sprick,et al.  A mobile robotic chemist , 2020, Nature.

[16]  Manuel Lopes,et al.  Body schema acquisition through active learning , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  David Cohn,et al.  Active Learning , 2010, Encyclopedia of Machine Learning.

[18]  Pierre-Yves Oudeyer,et al.  Active learning of inverse models with intrinsically motivated goal exploration in robots , 2013, Robotics Auton. Syst..

[19]  Katharina Pentenrieder Analysis of Tracking Accuracy for Single-Camera Square-Marker-Based Tracking , 2007 .

[20]  Tony J. Dodd,et al.  Feeling the Shape: Active Exploration Behaviors for Object Recognition With a Robotic Hand , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.