Teleoperation control of Baxter robot using body motion tracking

In this paper, we use Kinect Xbox 360 sensor to implement the motion control of Baxter robot, a semi humanoid robot with limbs of 7 DOF joints with collision avoidance capabilities. Two different methods using vector approach and inverse kinematics approach have been designed to achieve a given task. Primitive experiments have been carried out to verify the effectiveness of the developed methods. Human motions is captured by Kinect sensor and calculated with Processing Software using SimpleOpenNI wrapper for OpenNI and NITE. UDP protocol is adopted to send reference motion to Baxter robot. Python and RosPy script programming kit is used to calculate joint angles of Baxter robot based on vector approach and inverse kinematics approach. The experimental results demonstrate that both of our proposed approaches have achieved satisfactory performance.

[1]  Fakhteh Soltani,et al.  Developing a Gesture-Based Game for Deaf/Mute People Using Microsoft Kinect , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[2]  Greg Borenstein,et al.  Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot , 2012 .

[3]  Garrett M. Clayton,et al.  Integrating the Microsoft Kinect With Simulink: Real-Time Object Tracking Example , 2014, IEEE/ASME Transactions on Mechatronics.

[4]  H. Hashimoto,et al.  Human motion tracking of mobile robot with Kinect 3D sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[5]  Ieee Staff.  2013 IEEE 19th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA) , 2013 .

[6]  Luiz Velho,et al.  Kinect and RGBD Images: Challenges and Applications , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images Tutorials.

[7]  Charles E. Colvin,et al.  Multiple user motion capture and systems engineering , 2011, 2011 IEEE Systems and Information Engineering Design Symposium.

[8]  Wolfgang Slany,et al.  ROS-based mapping, localization and autonomous navigation using a Pioneer 3-DX robot and their relevant issues , 2011, 2011 Saudi International Electronics, Communications and Photonics Conference (SIECPC).

[9]  Cliff Fitzgerald,et al.  Developing baxter , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[10]  Tatsuo Nakajima,et al.  Game Based Approach to Learn Martial Arts for Beginners , 2012, 2012 IEEE International Conference on Embedded and Real-Time Computing Systems and Applications.