OMG: Introducing optical myography as a new human machine interface for hand amputees

Given the recent progress in the development of computer vision, it is nowadays possible to optically track features of the human body with unprecedented precision. We take this as a starting point to build a novel human-machine interface for the disabled. In this particular work we explore the possibility of visually inspecting the human forearm to detect what fingers are moving, and to what extent. In particular, in a psychophysical experiment with ten intact subjects, we tracked the deformations of the surface of the forearm to try and reconstruct intended finger motions. Ridge Regression was used for the reconstruction. The results are highly promising, leading to an average error in the range of 0.13 to 0.2 (normalized root mean square error). If further successfully tested in the large, this approach could represent a fully fledged alternative / replacement to similar traditional interfaces such as, e.g., surface electromyography.

[1]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[2]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[3]  Claudio Castellini,et al.  A wearable low-cost device based upon Force-Sensing Resistors to detect single-finger forces , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[4]  Hong Liu,et al.  EMG pattern recognition and grasping force estimation: Improvement to the myocontrol of multi-DOF prosthetic hands , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Andreas Attenberger,et al.  Prostheses Control with Combined Near-Infrared and Myoelectric Signals , 2011, EUROCAST.

[6]  Don A. Yungher,et al.  Surface muscle pressure as a measure of active and passive behavior of muscles during gait. , 2011, Medical engineering & physics.

[7]  Vineet R. Kamat,et al.  AUGMENTED REALITY MARKERS AS SPATIAL INDICES FOR INDOOR MOBILE AECFM APPLICATIONS , 2012 .

[8]  Claudio Castellini,et al.  A realistic implementation of ultrasound imaging as a human-machine interface for upper-limb amputees , 2013, Front. Neurorobot..

[9]  Keehoon Kim,et al.  Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. , 2011, Brain : a journal of neurology.

[10]  Vineet R. Kamat,et al.  Collaborative visualization of engineering processes using tabletop augmented reality , 2013, Adv. Eng. Softw..

[11]  D Howard,et al.  Dimensional change in muscle as a control signal for powered upper limb prostheses: a pilot study. , 1999, Medical engineering & physics.

[12]  Roberto Merletti,et al.  Advances in surface EMG: recent progress in detection and processing techniques. , 2010, Critical reviews in biomedical engineering.

[13]  Edwin Olson,et al.  AprilCal: Assisted and repeatable camera calibration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[15]  Chung-Lin Huang,et al.  A multi-view vision-based hand motion capturing system , 2011, Pattern Recognit..

[16]  Vincent Lepetit,et al.  Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes , 2011, 2011 International Conference on Computer Vision.

[17]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  Sam L. Phillips,et al.  Residual kinetic imaging: a versatile interface for prosthetic control , 2005, Robotica.

[19]  Vincent Lepetit,et al.  Dominant orientation templates for real-time detection of texture-less objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Claudio Castellini,et al.  FFLS: An accurate linear device for measuring synergistic finger contractions , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Rajendra Katti,et al.  OPTICALLY-BASED CONTROL OF A PROSTHETIC DEVICE , .

[22]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.

[23]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[24]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  D. Coyle,et al.  The experience of agency in human-computer interactions: a review , 2014, Front. Hum. Neurosci..