Skill acquisition from human demonstration using a hidden Markov model

A new approach to skill acquisition in assembly is proposed. An assembly skill is represented by a hybrid dynamic system where a discrete event controller models the skill at the task level. The output of the discrete event controller provides the reference commands for the underlying robot controller. This structure is naturally encoded by a hidden Markov model (HMM). The HMM parameters are obtained by training on sensory data from human demonstrations of the skill. Currently, assembly tasks have to be performed by human operators or by robots using expensive fixtures. Our approach transfers the assembly skill from an expert human operator to the robot, thus making it possible for a robot to perform assembly tasks without the use of expensive fixtures.

[1]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[2]  Blake Hannaford,et al.  Hidden Markov Model Analysis of Force/ Torque Information in Telemanipulation , 1989, ISER.

[3]  Blake Hannaford,et al.  Hidden Markov Model Analysis of Force/Torque Information in Telemanipulation , 1991, Int. J. Robotics Res..

[4]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[5]  Sheng Liu,et al.  Transfer of Human Skills to Robots: Learning from Human Demonstrations for Building an Adaptive Control System , 1992, 1992 American Control Conference.

[6]  Nathan Delson,et al.  Robot programming by human demonstration: the use of human inconsistency in improving 3D robot trajectories , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[7]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[8]  B. J. McCarragher,et al.  The discrete event control of robotic assembly tasks , 1995 .

[9]  Jie Yang,et al.  Towards human-robot coordination: skill modeling and transferring via hidden Markov model , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[10]  Pradeep K. Khosla,et al.  Sensorimotor primitives for robotic assembly skills , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[11]  H. Harry Asada,et al.  The Discrete Event Modeling and Trajectory Planning of Robotic Assembly Tasks , 1995 .

[12]  Geir Hovland,et al.  Frequency-domain force measurements for discrete event contact recognition , 1996, Proceedings of IEEE International Conference on Robotics and Automation.