Robot Control and Online Programming by Human Gestures Using a Kinect Motion Sensor

Monitoring and controlling of robots are key competences for robot producers and many research and development projects are carried out to increase robot performance and add new functionality. The paper presents a concept and implementation of online programming, controlling and monitoring an industrial robot using a Kinect sensor as a HMI part. Presented innovative solution is based on human gestures. A communication interface for gestures analysis performed by the robot operator was created using LabVIEW applications. Communication between the kinetic motion sensor and the robot was carried out through PLC Siemens S7-300 inside a flexible manufacturing system. The connection between the logic controller and the robot controller R30iA was realized in the ProfibusDP network. The connection between the controller and LabVIEW application has been established using the MPI protocol. A hardware communication protocol used by PLC was converted into the OPC protocol. NUI was used to communicate the Kinect with LabVIEW.

[1]  Achim J. Lilienthal,et al.  Comparative evaluation of range sensor accuracy for indoor mobile robotics and automated logistics applications , 2013, Robotics Auton. Syst..

[2]  Cezary Grabowik,et al.  Object-Oriented Models in an Integration of CAD/CAPP/CAP Systems , 2011, HAIS.

[3]  John Norrish,et al.  Recent Progress on Programming Methods for Industrial Robots , 2010, ISR/ROBOTIK.

[4]  Sławomir Zolkiewski.  Numerical Application for Dynamical Analysis of Rod and Beam Systems in Transportation , 2010 .

[5]  Zhi-Ren Tsai,et al.  Robust Kinect-based guidance and positioning of a multidirectional robot by Log-ab recognition , 2014, Expert Syst. Appl..

[6]  Wolfram Burgard,et al.  Efficient grid-based spatial representations for robot navigation in dynamic environments , 2013, Robotics Auton. Syst..

[7]  Thierry Oggier,et al.  Miniature 3D TOF Camera for Real-Time Imaging , 2006, PIT.

[8]  Sławomir Zolkiewski.  Attenuation-Frequency Characteristics of Beam Systems in Spatial Motion , 2010 .

[9]  Hong Wei,et al.  A survey of human motion analysis using depth imagery , 2013, Pattern Recognit. Lett..

[10]  Damiano Verda,et al.  Structure-based object representation and classification in mobile robotics through a Microsoft Kinect , 2013, Robotics Auton. Syst..

[11]  Sung-Bae Cho,et al.  Hybrid Artificial Intelligent Systems , 2015, Lecture Notes in Computer Science.

[12]  Danica Kragic,et al.  Dual arm manipulation - A survey , 2012, Robotics Auton. Syst..

[13]  Sławomir Zolkiewski.  Dynamical Flexibility of Complex Damped Systems Vibrating Transversally in Transportation , 2010 .

[14]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[15]  Sławomir Zolkiewski,et al.  Vibrations of beams with a variable cross-section fixed on rotational rigid disks , 2013 .

[16]  Svenja Kahn,et al.  Towards precise real-time 3D difference detection for industrial applications , 2013, Comput. Ind..

[17]  Reinhard Koch,et al.  Time-of-Flight Sensors in Computer Graphics , 2009, Eurographics.

[18]  Torgny Brogårdh,et al.  Present and future robot control development - An industrial perspective , 2007, Annu. Rev. Control..

[19]  Ross A. Clark,et al.  Evaluation of foot posture using the Microsoft Kinect , 2013 .

[20]  Pedro Arias,et al.  Metrological evaluation of Microsoft Kinect and Asus Xtion sensors , 2013 .

[21]  Slawomir Zólkiewski,et al.  Damped vibrations Problem of beams Fixed on the rotational Disk , 2011, Int. J. Bifurc. Chaos.

[22]  Z Slawomir˙.  DAMPED VIBRATIONS PROBLEM OF BEAMS FIXED ON THE ROTATIONAL DISK , 2011 .