Controlling a remotely located robot using hand gestures in real time: A DSP implementation

Telepresence is a necessity for this time as we can't reach everywhere and also it's useful in saving human life at dangerous places. A robot, which could be controlled from a distant location, can solve these problems. This could be via communication waves or networking methods. Also controlling should be real time and so smooth that it can actuate on every minor signal in an effective way. Robot control through hand gesture in real time has been an investigative area among researchers. This paper discusses a method controlling a robot over the network from a distant location. The robot is controlled by hand gestures which were captured by camera live. A DSP board TMS320DM642EVM was used to implement image pre-processing and fastening the system. PCA was used for gesture classification and robot actuation would happen according to predefined procedures. Classification information was sent over the network in the experiment. This method is robust and could be used to control any kind of robot over distance.

[1]  Mengyin Fu,et al.  Teleoperation of a virtual iCub robot under framework of parallel system via hand gesture recognition , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[2]  M. Bhuiyan.  Gesture-controlled user interfaces , what have we done and what ’ s next ? , 2009 .

[3]  Dan Ionescu,et al.  An intelligent gesture interface for controlling TV sets and set-top boxes , 2011, 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[4]  Ankit Chaudhary,et al.  Bent fingers' angle calculation using supervised ANN to control electro-mechanical robotic hand , 2013, Comput. Electr. Eng..

[5]  Ankit Chaudhary,et al.  A Survey on Hand Gesture Recognition in Context of Soft Computing , 2011 .

[6]  Ankit Chaudhary,et al.  Real-time hand gesture recognition in FPGA , 2016 .

[7]  Guanglong Du,et al.  A Markerless Human–Robot Interface Using Particle Filter and Kalman Filter for Dual Robots , 2015, IEEE Transactions on Industrial Electronics.

[8]  Jong Ho Choi,et al.  Morphological gesture recognition algorithm , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[9]  Chin-Boon Chng,et al.  Hand gesture guided robot-assisted surgery based on a direct augmented reality interface , 2014, Comput. Methods Programs Biomed..

[10]  Jagdish Lal Raheja,et al.  Principal Component Analysis for Gesture Recognition Using SystemC , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[11]  Ankit Chaudhary,et al.  A Vision based Real Time System to Control Remote Robotic Hand Fingers , 2011 .

[12]  Pinhas Ben-Tzvi,et al.  RML Glove—An Exoskeleton Glove Mechanism With Haptics Feedback , 2015, IEEE/ASME Transactions on Mechatronics.

[13]  Ankit Chaudhary,et al.  Real Time Fabric Defect Detection System on an Embedded DSP Platform , 2014, ArXiv.