A human–robot interface using particle filter, Kalman filter, and over-damping method

This paper presents a novel human–manipulator interface which copies the hand motion to control a manipulator. In the proposed interface, an inertial measurement unit is used to measure the orientation of the human hand, and a 3D camera is employed to locate the human hand using the Camshift algorithm. Although the position and the orientation of the human can be obtained from two sensors, the measurement errors increase over time due to the noise of the devices and the tracking errors. Therefore, particle filter and Kalman filter are used to estimate the position and the orientation of the human hand. Due to the limitations of the perceptive and the motor, human operator cannot accomplish the high-precision manipulation without any assistance. An over-damping method is employed to assist the operator to improve the accuracy and reliability in determining the postures of the manipulator. The human–manipulator interface system was experimentally tested in a lab environment, and the results indicate that such an interface can successfully control a robot manipulator even when the operator is not an expert.

[1]  Guanglong Du,et al.  Online Serial Manipulator Calibration Based on Multisensory Process Via Extended Kalman and Particle Filters , 2014, IEEE Transactions on Industrial Electronics.

[2]  Man Ho Kim,et al.  Kalman Predictive Redundancy System for Fault Tolerance of Safety-Critical Systems , 2010, IEEE Transactions on Industrial Informatics.

[3]  Keum-Bae Cho,et al.  Intelligent Lead: A Novel HRI Sensor for Guide Robots , 2012, Sensors.

[4]  Guanglong Du,et al.  A novel human-robot interface using hybrid sensors with Kalman filters , 2014, Ind. Robot.

[5]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[6]  Gianluca Antonelli,et al.  A new on-line algorithm for inverse kinematics of robot manipulators ensuring path tracking capability under joint limits , 2003, IEEE Trans. Robotics Autom..

[7]  Robert B. McGhee,et al.  A Simplified Quaternion-Based Algorithm for Orientation Estimation From Earth Gravity and Magnetic Field Measurements , 2008, IEEE Transactions on Instrumentation and Measurement.

[8]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[9]  Sandra Hirche,et al.  Human-Oriented Control for Haptic Teleoperation , 2012, Proceedings of the IEEE.

[10]  Ping Zhang,et al.  Human–Manipulator Interface Based on Multisensory Process via Kalman Filters , 2014, IEEE Transactions on Industrial Electronics.

[11]  Mehran Jahed,et al.  A Neuro–Fuzzy Inference System for sEMG-Based Identification of Hand Motion Commands , 2011, IEEE Transactions on Industrial Electronics.

[12]  Toshio Fukuda,et al.  An exoskeletal robot for human elbow motion support-sensor fusion, adaptation, and control , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Javier Ruiz Hidalgo,et al.  Real-Time Head and Hand Tracking Based on 2.5D Data , 2012 .

[14]  Changhe Yuan,et al.  Theoretical analysis and practical insights on importance sampling in Bayesian networks , 2007, Int. J. Approx. Reason..

[15]  Jianwei Zhang,et al.  A two-arm situated artificial communicator for human-robot cooperative assembly , 2003, IEEE Trans. Ind. Electron..

[16]  Takeshi Ando,et al.  A Haptic Interface “Force Blinker 2” for Navigation of the Visually Impaired , 2012, IEEE Transactions on Industrial Electronics.

[17]  Annamária R. Várkonyi-Kóczy,et al.  Human–Computer Interaction for Smart Environment Applications Using Fuzzy Hand Posture and Gesture Models , 2011, IEEE Transactions on Instrumentation and Measurement.

[18]  Gora Chand Nandi,et al.  Toward Developing a Computational Model for Bipedal Push Recovery–A Brief , 2015, IEEE Sensors Journal.

[19]  Gora Chand Nandi,et al.  Biologically-inspired push recovery capable bipedal locomotion modeling through hybrid automata , 2015, Robotics Auton. Syst..

[20]  Farid Golnaraghi,et al.  A Fastening Tool Tracking System Using an IMU and a Position Sensor With Kalman Filters and a Fuzzy Expert System , 2009, IEEE Transactions on Industrial Electronics.

[21]  Guanglong Du,et al.  A Markerless Human–Robot Interface Using Particle Filter and Kalman Filter for Dual Robots , 2015, IEEE Transactions on Industrial Electronics.

[22]  Raul Wirz,et al.  A multimodal interface to control a robot arm via the web: a case study on remote programming , 2005, IEEE Transactions on Industrial Electronics.

[23]  William Melek,et al.  Fastening tool tracking system using a Kalman filter and particle filter combination , 2011 .

[24]  Tharam S. Dillon,et al.  Enhancement of Speech Recognitions for Control Automation Using an Intelligent Particle Swarm Optimization , 2012, IEEE Transactions on Industrial Informatics.

[25]  Kiyoshi Ohishi,et al.  Force Control of Human–Robot Interaction Using Twin Direct-Drive Motor System Based on Modal Space Design , 2010, IEEE Transactions on Industrial Electronics.

[26]  Tsukasa Ogasawara,et al.  A hand-pose estimation for vision-based human interfaces , 2003, IEEE Trans. Ind. Electron..

[27]  Jonathan Kofman,et al.  Robot-Manipulator Teleoperation by Markerless Vision-Based Hand-Arm Tracking , 2007 .

[28]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[29]  Hubert Konik,et al.  CAMSHIFT improvement on multi-hue object and multi-object tracking , 2011, 3rd European Workshop on Visual Information Processing.