Kinect-Based Sliding Mode Control for Lynxmotion Robotic Arm

Recently, the technological development of manipulator robot increases very quickly and provides a positive impact to human life. The implementation of the manipulator robot technology offers more efficiency and high performance for several human’s tasks. In reality, efforts published in this context are focused on implementing control algorithms with already preprogrammed desired trajectories passive robots case or trajectory generation based on feedback sensors active robots case. However, gesture based control robot can be considered as another channel of system control which is not widely discussed. This paper focuses on a Kinect-based real-time interactive control system implementation. Based on LabVIEW integrated development environment IDE, a developed human-machine-interface HMI allows user to control in real time a Lynxmotion robotic arm. The Kinect software development kit SDK provides a tool to keep track of human body skeleton and abstract it into 3-dimensional coordinates. Therefore, the Kinect sensor is integrated into our control system to detect the different user joints coordinates. The Lynxmotion dynamic has been implemented in a real-time sliding mode control algorithm. The experimental results are carried out to test the effectiveness of the system, and the results verify the tracking ability, stability, and robustness.

[1]  Nabil Derbel,et al.  Nonlinear control and synchronization with time delays of multiagent robotic systems , 2011 .

[2]  Nabil Derbel,et al.  Distributed Synchronization Control to Trajectory Tracking of Multiple Robot Manipulators , 2011, J. Robotics.

[3]  Marcelo R. Campo,et al.  Easy gesture recognition for Kinect , 2014, Adv. Eng. Softw..

[4]  Chokri Rekik,et al.  Design Of Smart Robot For Wrist Rehabilitation , 2016 .

[5]  Tsukasa Ogasawara,et al.  A hand-pose estimation for vision-based human interfaces , 2003, IEEE Trans. Ind. Electron..

[6]  Chokri Rekik,et al.  Kinect-based Computed Torque Control for lynxmotion robotic arm , 2015, 2015 7th International Conference on Modelling, Identification and Control (ICMIC).

[7]  Kuo-Chung Chu,et al.  Development and Evaluation of Game-Based Learning System Using the Microsoft Kinect Sensor , 2015, Int. J. Distributed Sens. Networks.

[8]  Songmin Jia,et al.  Obstacles Regions 3D-Perception Method for Mobile Robots Based on Visual Saliency , 2015, J. Robotics.

[9]  Pierre Payeur,et al.  Rapid 3D Modeling and Parts Recognition on Automotive Vehicles Using a Network of RGB-D Sensors for Robot Guidance , 2013, J. Sensors.

[10]  Mohammad Al-Shabi.  Simulation and Implementation of Real-Time Vision-Based Control System for 2-DoF Robotic Arm Using PID with Hardware-in-the-Loop , 2015 .

[11]  Kelly J. Bower,et al.  Clinical feasibility of interactive motion-controlled games for stroke rehabilitation , 2015, Journal of NeuroEngineering and Rehabilitation.

[12]  Jonathan Kofman,et al.  Robot-Manipulator Teleoperation by Markerless Vision-Based Hand-Arm Tracking , 2007 .

[13]  Hongwei Ma,et al.  Kinect-Based Vision System of Mine Rescue Robot for Low Illuminous Environment , 2016, J. Sensors.

[14]  Mervyn J Miles,et al.  Kinect 4 … holographic optical tweezers , 2013 .

[15]  Patrick Lambert,et al.  Dynamic Hand Gesture Recognition Using the Skeleton of the Hand , 2005, EURASIP J. Adv. Signal Process..

[16]  HyeSuk Kim,et al.  Dynamic Arm Gesture Recognition Using Spherical Angle Features and Hidden Markov Models , 2015, Adv. Hum. Comput. Interact..

[17]  Adrian F. Clark,et al.  A Navigation System for the Visually Impaired: A Fusion of Vision and Depth Sensor , 2015, Applied bionics and biomechanics.

[18]  Carlos Pillajo,et al.  Human Machine Interface HMI using Kinect sensor to control a SCARA Robot , 2013, 2013 IEEE Colombian Conference on Communications and Computing (COLCOM).

[19]  A. Procházka,et al.  THE MS KINECT USE FOR 3 D MODELLING AND GAIT ANALYSIS IN THE MATLAB ENVIRONMENT , 2013 .

[20]  Ren C. Luo,et al.  Real time human motion imitation of anthropomorphic dual arm robot based on Cartesian impedance control , 2013, 2013 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[21]  Kun Qian,et al.  Developing a Gesture Based Remote Human-Robot Interaction System Using Kinect , 2013 .

[22]  Achmad Rizal,et al.  Proportional derivative control based robot arm system using Microsoft Kinect , 2013, 2013 International Conference on Robotics, Biomimetics, Intelligent Computational Systems.

[23]  Hsin-Chun Tsai,et al.  Improving Learning Performance with Happiness by Interactive Scenarios , 2014, TheScientificWorldJournal.

[24]  Alok Singh,et al.  Telemanipulation of an industrial robotic arm using gesture recognition with Kinect , 2013, 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE).

[25]  A. Shademan,et al.  Kinect technology for hand tracking control of surgical robots: technical and surgical skill comparison to current robotic masters , 2013, Surgical Endoscopy.

[26]  Leonardo Cunha de Miranda,et al.  A Case Study of MasterMind Chess: Comparing Mouse/Keyboard Interaction with Kinect-Based Gestural Interface , 2016, Adv. Hum. Comput. Interact..

[27]  Deok-Jin Lee,et al.  Hybrid Motion Planning Method for Autonomous Robots Using Kinect Based Sensor Fusion and Virtual Plane Approach in Dynamic Environments , 2015, J. Sensors.

[28]  Olfa Boubaker,et al.  Robot-Assisted Therapy: Design, Control and Optimization , 2012 .

[29]  Guanglong Du,et al.  Markerless human-robot interface for dual robot manipulators using Kinect sensor , 2014 .

[30]  Dejan B Popović,et al.  Microsoft Kinect-Based Artificial Perception System for Control of Functional Electrical Stimulation Assisted Grasping , 2014, BioMed research international.

[31]  Jianwei Zhang,et al.  A two-arm situated artificial communicator for human-robot cooperative assembly , 2003, IEEE Trans. Ind. Electron..

[32]  Terrence Fong,et al.  Novel interfaces for remote driving: gesture, haptic, and PDA , 2001, SPIE Optics East.

[33]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[34]  Ing-Jr Ding,et al.  An eigenspace-based method with a user adaptation scheme for human gesture recognition by using Kinect 3D data ☆ , 2015 .

[35]  Josep Amat,et al.  A multi-robot cooperation strategy for dexterous task oriented teleoperation , 2015, Robotics Auton. Syst..

[36]  Nicolas Vuillerme,et al.  Real-Time Obstacle Detection System in Indoor Environment for the Visually Impaired Using Microsoft Kinect Sensor , 2016, J. Sensors.

[37]  Ajmal S. Mian,et al.  Using Kinect for face recognition under varying poses, expressions, illumination and disguise , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).