Recognition of Handwriting from Electromyography

Handwriting – one of the most important developments in human culture – is also a methodological tool in several scientific disciplines, most importantly handwriting recognition methods, graphology and medical diagnostics. Previous studies have relied largely on the analyses of handwritten traces or kinematic analysis of handwriting; whereas electromyographic (EMG) signals associated with handwriting have received little attention. Here we show for the first time, a method in which EMG signals generated by hand and forearm muscles during handwriting activity are reliably translated into both algorithm-generated handwriting traces and font characters using decoding algorithms. Our results demonstrate the feasibility of recreating handwriting solely from EMG signals – the finding that can be utilized in computer peripherals and myoelectric prosthetic devices. Moreover, this approach may provide a rapid and sensitive method for diagnosing a variety of neurogenerative diseases before other symptoms become clear.

[1]  Kengo Ohnishi,et al.  Neural machine interfaces for controlling multifunctional powered upper-limb prostheses , 2007, Expert review of medical devices.

[2]  C D Marsden,et al.  Primary writing tremor. , 1979, Journal of neurology, neurosurgery, and psychiatry.

[3]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[4]  Andrew J Fuglevand,et al.  Probability-based prediction of activity in multiple arm muscles: implications for functional electrical stimulation. , 2008, Journal of neurophysiology.

[5]  Gesine L. Alders,et al.  Kinematic analysis of dopaminergic effects on skilled handwriting movements in Parkinson’s disease , 2006, Journal of Neural Transmission.

[6]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[7]  Maria Caterina Silveri,et al.  Central and peripheral aspects of writing disorders in Alzheimer's disease , 2007, Journal of clinical and experimental neuropsychology.

[8]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[9]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[10]  Michael Shevell,et al.  Handwriting Performance in Children With Attention Deficit Hyperactivity Disorder (ADHD) , 2008, Journal of child neurology.

[11]  J. Uellendahl,et al.  Upper extremity myoelectric prosthetics. , 2000, Physical medicine and rehabilitation clinics of North America.

[12]  Claudio Luzzatti,et al.  Multiple patterns of writing disorders in dementia of the Alzheimer type and their evolution , 2003, Neuropsychologia.

[13]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Gerald Q. Maguire,et al.  Becoming Borg to Become Immortal: Regulating Brain Implant Technologies , 2007, Cambridge Quarterly of Healthcare Ethics.

[15]  Ian W. McKeague,et al.  A Statistical Model for Signature Verification , 2005 .

[16]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[17]  R. Elble,et al.  Primary writing tremor. A form of focal dystonia? , 1990, Movement disorders : official journal of the Movement Disorder Society.

[18]  Heather M Seifert,et al.  Restoration of Movement Using Functional Electrical Stimulation and Bayes' Theorem , 2002, The Journal of Neuroscience.

[19]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[20]  J. Basmajian Muscles Alive—their functions revealed by electromyography , 1963 .