Robot Manipulator Teaching Techniques with Use of Hand Gestures

Robot manipulator teaching is a time consuming procedure where qualified operator programs the execution path. In this paper we introduce and discuss the improvement of traditional teaching method with application of hand gesture recognition system. The paper presents the most common robot programming and hand gesture recognition issues and presents the possibility of joining this two research fields.

[1]  Kiyotaka Izumi,et al.  Posture control of a robot manipulator by evaluating fuzzy linguistic information based on user feedback , 2009, 2009 IEEE International Symposium on Industrial Electronics.

[2]  Tadeusz Szkodny.  Avoiding of the Kinematic Singularities of Contemporary Industrial Robots , 2014, ICIRA.

[3]  Dong Il Park,et al.  Development of an industrial robot manipulator for the easy and safe human-robot cooperation , 2010, ICCAS 2010.

[4]  Jerzy Klamka,et al.  An approach to observability analysis and estimation of human arm model , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[5]  Jungwon Yoon,et al.  Design of 6-DOF Manipulator Intuitive Teaching System Using Smart Phone Orientation: User Friendly and Intuitive Teaching Operation for 6-DOF Manipulator , 2013, 2013 4th International Conference on Intelligent Systems, Modelling and Simulation.

[6]  M. G. Sevillano,et al.  SLIDING-MODE LOOP VOLTAGE CONTROL USING ASTRA-MATLAB INTEGRATION IN TOKAMAK REACTORS , 2012 .

[7]  Ankit Chaudhary,et al.  Intelligent Approaches to interact with Machines using Hand Gesture Recognition in Natural way: A Survey , 2011, ArXiv.

[8]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[9]  Daniel Thalmann,et al.  3D fingertip and palm tracking in depth image sequences , 2012, ACM Multimedia.

[10]  B. Smolka,et al.  A novel approach to the eye movement analysis using a high speed camera , 2012, 2012 2nd International Conference on Advances in Computational Tools for Engineering Applications (ACTEA).

[11]  Donald Lee Pieper.  The kinematics of manipulators under computer control , 1968 .

[12]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[13]  Tadeusz Szkodny.  The Algorithm Camera Computing the Object Location , 2013, ICIRA.

[14]  Artur Babiarz,et al.  Mathematical model of a human leg: The switched linear system approach , 2015, 2015 International Conference on Pervasive and Embedded Computing and Communication Systems (PECCS).

[15]  T. Szkodny.  Forward and inverse kinematics of IRb-6 manipulator , 1995 .

[16]  Adolfo López,et al.  Real-time fingertip localization conditioned on hand gesture classification , 2014, Image Vis. Comput..

[17]  Jakub Nalepa,et al.  Real-Time Wrist Localization in Hand Silhouettes , 2013, CORES.

[18]  Chutisant Kerdvibulvech,et al.  A methodology for hand and finger motion analysis using adaptive probabilistic models , 2014, EURASIP J. Embed. Syst..

[19]  Izaskun Garrido Hernandez,et al.  ASTRA — Matlab integration for the control of tokamaks , 2009, 2009 IEEE International Conference on Control and Automation.

[20]  M Amundarain,et al.  Control strategies for OWC wave power plants , 2010, Proceedings of the 2010 American Control Conference.

[21]  Jungwon Yoon,et al.  Smartphone Based Control Architecture of Teaching Pendant for Industrial Manipulators , 2013, 2013 4th International Conference on Intelligent Systems, Modelling and Simulation.

[22]  J. Pucik,et al.  Fingertip detection for virtual keyboard based on camera , 2013, 2013 23rd International Conference Radioelektronika (RADIOELEKTRONIKA).

[23]  Artur Babiarz.  On mathematical modelling of the human arm using switched linear system , 2014 .

[24]  Ignazio Infantino,et al.  Visual control of a robotic hand , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[25]  Tadeusz Szkodny,et al.  The Basic Component of Computational Intelligence for KUKA KR C3 Robot , 2011, ICIRA.

[26]  Krzysztof Jaskot,et al.  The dynamics of the human arm with an observer for the capture of body motion parameters , 2013 .

[27]  Daniel Thalmann,et al.  Model-based hand pose estimation via spatial-temporal hand parsing and 3D fingertip localization , 2013, The Visual Computer.

[28]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[29]  Tadeusz Szkodny,et al.  Solution Algorithm of Inverse Kinematics Problem for Kuka KRC3 Robots , 2011, ICMMI.

[30]  Michal Niezabitowski,et al.  Comparison of Hand Feature Points Detection Methods , 2014, DoCEIS.

[31]  Rafiqul Zaman Khan,et al.  Survey on Various Gesture Recognition Technologies and Techniques , 2012 .

[32]  Tadeusz Szkodny,et al.  Accuracy of Determining the Coordinates of Points Observed by Camera , 2014, ICIRA.

[33]  Jerzy Klamka,et al.  Dynamics Modeling of 3D Human Arm Using Switched Linear Systems , 2015, ACIIDS.

[34]  Thomas S. Huang,et al.  Image processing , 1971 .

[35]  Artur Babiarz,et al.  Developing and Implementation of the Walking Robot Control System , 2013, ICMMI.

[36]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.

[37]  Makoto Mizukawa,et al.  Fast Hand Feature Extraction Based on Connected Component Labeling, Distance Transform and Hough Transform , 2009, J. Robotics Mechatronics.

[38]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[39]  M. De la Sen,et al.  Sliding-Mode Control of Wave Power Generation Plants , 2012, IEEE Transactions on Industry Applications.

[40]  Jerzy Klamka,et al.  The mathematical model of the human arm as a switched linear system , 2014, 2014 19th International Conference on Methods and Models in Automation and Robotics (MMAR).

[41]  Tadeusz Szkodny.  Basic Component of Computational Intelligence for IRB-1400 Robots , 2009, ICMMI.

[42]  Mathias Perrollaz,et al.  Teachless teach-repeat: Toward vision-based programming of industrial robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[43]  Gregory Z. Grudic,et al.  Iterative inverse kinematics with manipulator configuration control , 1993, IEEE Trans. Robotics Autom..

[44]  Tadeusz Szkodny,et al.  Calculation of the Location Coordinates of an Object Observed by a Camera , 2013, ICMMI.

[45]  Jakub Nalepa,et al.  Skin Detection and Segmentation in Color Images , 2014 .

[46]  Aitor J. Garrido,et al.  Internal inductance predictive control for Tokamaks , 2014, 2014 World Automation Congress (WAC).

[47]  Artur Babiarz,et al.  KUKA Robot Motion Planning Using the 1742 NI Smart Camera , 2013, ICMMI.