Intuitive Gesture Control of robots with a sensor arm sleeve based on dielectric elastomer sensors

Different types of robots help to fulfill simple work on their own like simple pick-and-place, handling and mounting tasks over long-lasting periods with no loss of accuracy and speed. However, regarding to products produced in small numbers the programming of those robots can be very time-consuming and workers have to be trained in programming the movements and tasks. Also, in the medical field where robots can be used for assistance during surgery or cancer treatment in future the surgeon or doctor has to respond to each patient individually. To train those medical specialists in programming robots would be very extensive. Therefore, the development of an intuitive robot control can help to facilitate tasks done by non-specialized workers or surgeons. In this contribution a concept of an intuitive control of robots via gesture control is shown. For the perception of gestures the different degrees of freedom of the worker's arm are detected by the use of a wearable sensor system based on dielectric elastomer sensors, which are generally lightweight and flexible. This paper describes the whole system consisting of an arm sleeve with attached stretch sensors, an analysis circuit board, the used software for communication and data processing as well as the controlling of the robot and the robot itself. Experiments show promising results, which are also specified in this paper. Furthermore, suggestions of different future applications based on dielectric elastomer sensors for example as artificial skin of prostheses are discussed.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Mithileysh Sathiyanarayanan,et al.  Controlling a Robot Using a Wearable Device (MYO) , 2015 .

[3]  W. Marsden I and J , 2012 .

[4]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[5]  Ron Pelrine,et al.  Standards for dielectric elastomer transducers , 2015 .

[6]  Ron Pelrine,et al.  Electrostriction of polymer films for microactuators , 1997, Proceedings IEEE The Tenth Annual International Workshop on Micro Electro Mechanical Systems. An Investigation of Micro Structures, Sensors, Actuators, Machines and Robots.

[7]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Dirk Brokken,et al.  Combined driving and sensing circuitry for dielectric elastomer actuators in mobile applications , 2011, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[9]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Sebastian Thrun,et al.  A Gesture Based Interface for Human-Robot Interaction , 2000, Auton. Robots.

[11]  Maximilian Landgraf,et al.  Dielectric elastomer actuators as self-sensing devices: a new method of superimposing actuating and sensing signals , 2015, Smart Structures.

[12]  Iain A. Anderson,et al.  Stretch sensors for human body motion , 2014, Smart Structures.

[13]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[14]  Christopher Assad,et al.  BioSleeve: A natural EMG-based interface for HRI , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Alexander Refsum Jensenius,et al.  Mumyo - evaluating and exploring the myo armband for musical interaction , 2015, NIME.