Skill Evaluation of Human Operators in Partly Automated Mobile Working Machines

The performance of a mobile working machine is strongly dependent on the skills of the operator. It is commonly accepted that among operators, productivity may vary tens of percents. This research considers the human skill evaluation in working machines during normal work. A general framework for skill evaluation via task sequence recognition by a hidden Markov model (HMM) is described. The definitions of skill metrics, based on task resource consumption, task completion frequency, task difficulty, and ability to plan and make decisions, are given and justified through an example. The skill evaluation methods are illustrated by utilizing them in two industrial applications.

[1]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[2]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[3]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[4]  L. R. Rabiner,et al.  An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition , 1983, The Bell System Technical Journal.

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  J.N.L. Brummer,et al.  Characterization of digital channels using hidden Markov models , 1992, Proceedings of the 1992 South African Symposium on Communications and Signal Processing.

[7]  I. Nimmo,et al.  Adequately address abnormal operations , 1995 .

[8]  Yangsheng Xu,et al.  Human action learning via hidden Markov model , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[9]  D. W. Repperger,et al.  Skill evaluation of human operators , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[10]  Fumiharu Fujiwara,et al.  Modeling of the peg-in-hole task based on impedance parameters and HMM , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[11]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[12]  Chris W. Johnson.  Why human error modeling has failed to help systems development , 1999, Interact. Comput..

[13]  Krishna R. Pattipati,et al.  A hidden Markov model-based algorithm for fault diagnosis with partial and imperfect tests , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[14]  Carey Bunks,et al.  CONDITION-BASED MAINTENANCE OF MACHINES USING HIDDEN MARKOV MODELS , 2000 .

[15]  J. Edward Colgate,et al.  Cobot architecture , 2001, IEEE Trans. Robotics Autom..

[16]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[17]  Sten Gellerstedt.  Operation of the Single-Grip Harvester: Motor-Sensory and Cognitive Work , 2002 .

[18]  Allison M. Okamura,et al.  Recognition of operator motions for real-time assistance using virtual fixtures , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[19]  Blake Hannaford,et al.  Minimally invasive surgery task decomposition--etymology of endoscopic suturing. , 2003, Studies in health technology and informatics.

[20]  Allison M. Okamura,et al.  Automatic Motion Recognition and Skill Evaluation for Dynamic Tasks , 2003 .

[21]  Katsuhisa Furuta,et al.  Control of pendulum: from Super Mechano-System to Human Adaptive Mechatronics , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[22]  K. Furuta,et al.  Skill evaluation based on state-transition model for human adaptive mechatronics (HAM) , 2004, 30th Annual Conference of IEEE Industrial Electronics Society, 2004. IECON 2004.

[23]  K. Furuta,et al.  Human adaptive mechatronics (HAM) for haptic system , 2004, 30th Annual Conference of IEEE Industrial Electronics Society, 2004. IECON 2004.

[24]  Jori Uusitalo,et al.  Characteristics and Significance of a Harvester Operators’ Working Technique in Thinnings , 2004 .

[25]  Rajiv V. Dubey,et al.  Robotic therapy for persons with disabilities using Hidden Markov Model based skill learning , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[26]  Hai Qiu,et al.  Degradation Assessment for Machinery Prognostics Using Hidden Markov Models , 2005 .

[27]  K. Furuta,et al.  Skill analysis of human in machine operation , 2005, 2005 International Conference on Neural Networks and Brain.

[28]  Y. Suzuki,et al.  Human skill and brain activity in machine operation , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[29]  Paolo Dario,et al.  Modelling and Evaluation of Surgical Performance Using Hidden Markov Models , 2006, IEEE Transactions on Biomedical Engineering.

[30]  Danica Kragic,et al.  Layered HMM for Motion Intention Recognition , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Fumio Harashima,et al.  Human adaptive mechatronics - interaction and intelligence , 2005, 9th IEEE International Workshop on Advanced Motion Control, 2006..

[32]  Satoshi Suzuki,et al.  Relation between skill revel and input-output time delay , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[33]  Kalevi Tervo,et al.  Hidden Markov models in step response evaluation , 2007 .

[34]  T. Sasaki,et al.  Operation skill quantification for mobile vehicle operation , 2007, SICE Annual Conference 2007.

[35]  Feng Duan,et al.  Analyzing human skill through control trajectories and motion capture data , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[36]  Du Ruxu,et al.  An Intelligent Online Monitoring and Diagnostic System for Manufacturing Automation , 2008, IEEE Transactions on Automation Science and Engineering.

[37]  Ruxu Du,et al.  An Intelligent Online Monitoring and Diagnostic System for Manufacturing Automation , 2008, IEEE Trans Autom. Sci. Eng..

[38]  Atsuo Takanishi,et al.  Enabling autonomous systems to perceptually detect human performance improvements and their applications , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[39]  Qi Cheng,et al.  Human intention recognition in Smart Assisted Living Systems using a Hierarchical Hidden Markov Model , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[40]  Oliver Brdiczka,et al.  Detecting Human Behavior Models From Multimodal Observation in a Smart Home , 2009, IEEE Transactions on Automation Science and Engineering.

[41]  Leyuan Shi,et al.  IEEE Transactions on Automation Science and Engineering , 2009, IEEE Transactions on Automation Science and Engineering.