State of the Art and Perspectives of Ultrasound Imaging as a Human-Machine Interface

Medical ultrasound imaging is a diagnostic tool based upon ultrasound wave production, propagation and processing, in use since the 1950s in the hospitals all over the world. The technique is totally safe, relatively cheap, easy to use and provides live images of the interiors of the human body at both high spatial and temporal resolutions. In this chapter we examine its use as a novel human-machine interface. Recent research indicates that it actually represents an effective, realistic tool for intention gathering, at least for the hand amputees. Given the current state of the art, medical ultrasound imaging can be used to control an upper-limb prosthesis to a high degree of precision; moreover, the related calibration procedure can be made extremely short and simple, with the aim of building an ultrasound-based online control system. We propose and discuss its pros and cons as an interface for the disabled, we elaborate on its potentialities as a tool for intention gathering, and we show that it has great potential in the short- and mid-term.

[1]  W. Grassi,et al.  A brief history of musculoskeletal ultrasound: 'From bats and ships to babies and hips'. , 2004, Rheumatology.

[2]  Jing-Yi Guo,et al.  Performances of one-dimensional sonomyography and surface electromyography in tracking guided patterns of wrist extension. , 2009, Ultrasound in medicine & biology.

[3]  Karl F. Graff,et al.  A History of Ultrasonics , 1981 .

[4]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[5]  Don A. Yungher,et al.  Surface muscle pressure as a measure of active and passive behavior of muscles during gait. , 2011, Medical engineering & physics.

[6]  Kenneth Sundaraj,et al.  Mechanomyogram for Muscle Function Assessment: A Review , 2013, PloS one.

[7]  T. Douglas,et al.  Ultrasound imaging in lower limb prosthetics , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[9]  Ira Krepchin,et al.  Texas Instruments Inc. , 1963, Nature.

[10]  Standards.  Training in diagnostic ultrasound: essentials, principles and standards. Report of a WHO Study Group. , 1998, World Health Organization technical report series.

[11]  Karl Theo Dussik.  Über die Möglichkeit, hochfrequente mechanische Schwingungen als diagnostisches Hilfsmittel zu verwerten , 1942 .

[12]  Jun Shi,et al.  Feasibility of controlling prosthetic hand using sonomyography signal in real time: preliminary study. , 2010, Journal of rehabilitation research and development.

[13]  Claudio Castellini,et al.  Ultrasound imaging as a human-machine interface in a realistic scenario , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[15]  David Howard,et al.  A comparative evaluation of sonomyography, electromyography, force, and wrist angle in a discrete tracking task. , 2011, Ultrasound in medicine & biology.

[16]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .

[17]  Yong-Ping Zheng,et al.  Human motion analysis with ultrasound and sonomyography , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  G. Deuschl,et al.  The motor system shows adaptive changes in complex regional pain syndrome. , 2007, Brain : a journal of neurology.

[19]  Jing-Yi Guo,et al.  Recognition of Finger Flexion from Ultrasound Image with Optical Flow: A Preliminary Study , 2010, 2010 International Conference on Biomedical Engineering and Computer Science.

[20]  D. J. Fritch,et al.  MEASUREMENTS OF ARTICULAR TISSUES WITH ULTRASOUND , 1958, American journal of physical medicine.

[21]  T. Elbert,et al.  Phantom-limb pain as a perceptual correlate of cortical reorganization following arm amputation , 1995, Nature.

[22]  O. Bretscher.  Linear Algebra with Applications , 1996 .

[23]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[24]  Hong-Bo Xie,et al.  Estimation of wrist angle from sonomyography using support vector machine and artificial neural network models. , 2009, Medical engineering & physics.

[25]  J. Alison Noble,et al.  Image Analysis Using Machine Learning: Anatomical Landmarks Detection in Fetal Ultrasound Images , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[26]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[27]  Q.H Huang,et al.  A System for the Synchronized Recording of Sonomyography, Electromyography and Joint Angle , 2007, The open biomedical engineering journal.

[28]  T. Jørgensen,et al.  Machine‐learning classification of non‐melanoma skin cancers from image features obtained by optical coherence tomography , 2008, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[29]  C. Castellini,et al.  Using Ultrasound Images of the Forearm to Predict Finger Positions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  V. Ramachandran,et al.  Touching the phantom limb , 1995, Nature.

[31]  Mathias Fink,et al.  Imaging of complex media with acoustic and seismic waves , 2002 .

[32]  Claudio Castellini,et al.  A realistic implementation of ultrasound imaging as a human-machine interface for upper-limb amputees , 2013, Front. Neurorobot..

[33]  Roberto Merletti,et al.  Technology and instrumentation for detection and conditioning of the surface electromyographic signal: state of the art. , 2009, Clinical biomechanics.

[34]  Kenneth M Heilman,et al.  Mirror therapy for phantom limb pain. , 2007, The New England journal of medicine.

[35]  Jørgen Arendt Jensen,et al.  Ultrasound Imaging and Its Modeling , 2002 .

[36]  P He,et al.  3-D imaging of residual limbs using ultrasound. , 1997, Journal of rehabilitation research and development.

[37]  Bruno-Marcel Mackert,et al.  Magnetoneurography: theory and application to peripheral nerve disorders , 2004, Clinical Neurophysiology.

[38]  Jing-Yi Guo,et al.  Recognition of finger flexion motion from ultrasound image: a feasibility study. , 2012, Ultrasound in medicine & biology.

[39]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[40]  Emanuel Zarka.  Prediction of finger movements using ultrasound images , 2011 .

[41]  Hong-Bo Xie,et al.  Towards the application of one-dimensional sonomyography for powered upper-limb prosthetic control using machine learning models , 2013, Prosthetics and orthotics international.

[42]  Siping Chen,et al.  Control of Powered Prosthetic Hand Using Multidimensional Ultrasound Signals: A Pilot Study , 2011, HCI.

[43]  S Micera,et al.  Control of Hand Prostheses Using Peripheral Information , 2010, IEEE Reviews in Biomedical Engineering.

[44]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[45]  Y. Zheng,et al.  Sonomyography: monitoring morphological changes of forearm muscles in actions with the feasibility for the control of powered prosthesis. , 2006, Medical engineering & physics.

[46]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[47]  Claudio Castellini,et al.  Ultrasound image features of the wrist are linearly related to finger positions , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[48]  Finley Fr,et al.  Myocoder studies of multiple myopotential response. , 1967 .

[49]  R. Cobbold.  Foundations of Biomedical Ultrasound , 2006 .

[50]  I. Donald,et al.  Investigation of abdominal masses by pulsed ultrasound. , 1958, Lancet.

[51]  Kai-Kuang Ma,et al.  Tumor segmentation from magnetic resonance imaging by learning via one-class support vector machine , 2004 .

[52]  G. Leopold,et al.  Ultrasound B-scanning in the differentiation of Baker's cyst and thrombophlebitis. , 1972, The British journal of radiology.

[53]  Jing-Yi Guo,et al.  Sonomyography (SMG) control for powered prosthetic hand: a study with normal subjects. , 2010, Ultrasound in medicine & biology.