Dynamic Handwriting Analysis for the Assessment of Neurodegenerative Diseases: A Pattern Recognition Perspective

Neurodegenerative diseases, for instance Alzheimer's disease (AD) and Parkinson's disease (PD), affect the peripheral nervous system, where nerve cells send messages that control muscles in order to allow movements. Sick neurons cannot control muscles properly. Handwriting involves cognitive planning, coordination, and execution abilities. Significant changes in handwriting performance are a prominent feature of AD and PD. This paper addresses the most relevant results obtained in the field of online (dynamic) analysis of handwritten trials by AD and PD patients. The survey is made from a pattern recognition point of view, so that different phases are described. Data acquisition deals not only with the device, but also with the handwriting task. Feature extraction can deal with function and parameter features. The classification problem is also discussed along with results already obtained. This paper also highlights the most profitable research directions.

[1]  J. Jankovic.  Parkinson’s disease: clinical features and diagnosis , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[2]  Betul Erdogdu Sakar,et al.  Improved spiral test using digitized graphics tablet for monitoring Parkinson's disease , 2014 .

[3]  G E Stelmach,et al.  in handwriting and similar tasks Parkinson ’ s disease patients undershoot target size , 2003 .

[4]  S. Rosenblum,et al.  Age-related changes in executive control and their relationships with activity performance in handwriting. , 2013, Human movement science.

[5]  Jirí Mekyska,et al.  A new modality for quantitative evaluation of Parkinson's disease: In-air movement , 2013, 13th IEEE International Conference on BioInformatics and BioEngineering.

[6]  L J Boë,et al.  Detecting Anticipatory Events in Handwriting Movements , 2000, Perception.

[7]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  K. Lowry,et al.  Planning and Control of Sequential Rapid Aiming in Adults With Parkinson's Disease , 2007, Journal of motor behavior.

[9]  M. Smith,et al.  Distorted visual feedback effects on drawing in Parkinson's disease. , 1997, Acta psychologica.

[10]  M. Folstein,et al.  The Mini-Mental State Examination. , 1983, Archives of general psychiatry.

[11]  H. Teulings,et al.  Handwriting and speech changes across the levodopa cycle in Parkinson's disease. , 1998, Acta psychologica.

[12]  G. Stelmach,et al.  The influence of mental and motor load on handwriting movements in parkinsonian patients. , 1998, Acta psychologica.

[13]  Christian O'Reilly,et al.  Writing Generation Model for Health Care Neuromuscular System Investigation , 2013, CIBB.

[14]  M. Samuel,et al.  Handwriting as an objective tool for Parkinson’s disease diagnosis , 2013, Journal of Neurology.

[15]  H. Möller,et al.  Kinematic Analysis of Handwriting Movements in Patients with Alzheimer’s Disease, Mild Cognitive Impairment, Depression and Healthy Subjects , 2003, Dementia and Geriatric Cognitive Disorders.

[16]  J. Bradshaw,et al.  Consistency of handwriting movements in dementia of the Alzheimer's type: A comparison with Huntington's and Parkinson's diseases , 1999, Journal of the International Neuropsychological Society.

[17]  N Mai,et al.  Computational analysis of open loop handwriting movements in Parkinson's disease: A rapid method to detect dopamimetic effects , 1996, Movement disorders : official journal of the Movement Disorder Society.

[18]  Marcos Faúndez-Zanuy,et al.  Contribution of different handwriting modalities to differential diagnosis of Parkinson's Disease , 2015, 2015 IEEE International Symposium on Medical Measurements and Applications (MeMeA) Proceedings.

[19]  Qiping Yu,et al.  Digitized Spiral Drawing: A Possible Biomarker for Early Parkinson’s Disease , 2016, PloS one.

[20]  Normand Teasdale,et al.  What can indices of handwriting quality tell us about Parkinsonian handwriting , 1991 .

[21]  G. Pirlo,et al.  On the measurement of local stability of handwriting: An application to static signature verification , 2010, 2010 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications.

[22]  Monika Bugdol,et al.  Spatial and dynamical handwriting analysis in mild cognitive impairment , 2017, Comput. Biol. Medicine.

[23]  A. Korczyn,et al.  Handwriting process variables discriminating mild Alzheimer's disease and mild cognitive impairment. , 2006, The journals of gerontology. Series B, Psychological sciences and social sciences.

[24]  Christoph Laske,et al.  Increased Diagnostic Accuracy of Digital vs. Conventional Clock Drawing Test for Discrimination of Patients in the Early Course of Alzheimer’s Disease from Cognitively Healthy Individuals , 2017, Front. Aging Neurosci..

[25]  Poonam Zham,et al.  Efficacy of Guided Spiral Drawing in the Classification of Parkinson's Disease , 2018, IEEE Journal of Biomedical and Health Informatics.

[26]  María Teresa Arredondo,et al.  Assessment of bradykinesia in Parkinson's disease patients through a multi-parametric system , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  John C Marshall,et al.  Micrographia in Parkinson’s disease: the effect of providing external cues , 1997, Journal of neurology, neurosurgery, and psychiatry.

[28]  Miguel Angel Ferrer-Ballester,et al.  Early Diagnosis of Neurodegenerative Diseases by Handwritten Signature Analysis , 2015, ICIAP Workshops.

[29]  Christian O'Reilly,et al.  Synthetic Handwritten Gesture Generation Using Sigma-Lognormal Model for Evolving Handwriting Classifiers , 2010 .

[30]  Angelo Marcelli,et al.  Do handwriting difficulties of Parkinson's patients depend on their impaired ability to retain the motor plan? A pilot study , 2017 .

[31]  Giuseppe Pirlo,et al.  Script Identification of Multi-Script Documents: A Survey , 2017, IEEE Access.

[32]  Gesine L. Alders,et al.  Kinematic analysis of dopaminergic effects on skilled handwriting movements in Parkinson’s disease , 2006, Journal of Neural Transmission.

[33]  Becky G. Farley,et al.  Repetitive Transcranial Magnetic Stimulation Improves Handwriting in Parkinson's Disease , 2013, Parkinson's disease.

[34]  Zdenek Smekal,et al.  Decision Support Framework for Parkinson’s Disease Based on Novel Handwriting Markers , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Dimitrios Hristu-Varsakelis,et al.  Machine learning-based classification of simple drawing movements in Parkinson's disease , 2017, Biomed. Signal Process. Control..

[36]  V. S. Chakravarthy,et al.  A computational model of Parkinsonian handwriting that highlights the role of the indirect pathway in the basal ganglia. , 2009, Human movement science.

[37]  Giuseppe Pirlo,et al.  Adaptive Score Normalization for Output Integration in Multiclassifier Systems , 2012, IEEE Signal Processing Letters.

[38]  George E. Stelmach,et al.  Continuously scaling a continuous movement: Parkinsonian patients choose a smaller scaling ratio and produce more variable movements compared to elderly controls , 2001 .

[39]  Clayton R. Pereira,et al.  Deep Learning-Aided Parkinson's Disease Diagnosis from Handwritten Dynamics , 2016, 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[40]  Giuseppe Pirlo,et al.  Updating Knowledge in Feedback-Based Multi-classifier Systems , 2011, 2011 International Conference on Document Analysis and Recognition.

[41]  Oana Geman.  Nonlinear dynamics, artificial neural networks and neuro-fuzzy classifier for automatic assessing of tremor severity , 2013, 2013 E-Health and Bioengineering Conference (EHB).

[42]  Giuseppe Pirlo,et al.  A Feedback-Based Multi-Classifier System , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[43]  Taha Khan,et al.  A Computer Vision Framework For Finger-Tapping Evaluation In Parkinson's Disease , 2013 .

[44]  Michael Fairhurst,et al.  Improved Screening of Developmental Dyspraxia using On-Line Image Analysis , 2004 .

[45]  Andreas Daffertshofer,et al.  Impairment of complex upper limb motor function in de novo Parkinson's disease. , 2008, Parkinsonism & related disorders.

[46]  Susanne Walitza,et al.  Brain dopamine and kinematics of graphomotor functions. , 2006, Human movement science.

[47]  Amir Shmuel,et al.  Performance of machine learning methods in diagnosing Parkinson’s disease based on dysphonia measures , 2017, Biomedical Engineering Letters.

[48]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[49]  Marcos Faúndez-Zanuy,et al.  EMOTHAW: A Novel Database for Emotional State Recognition From Handwriting and Drawing , 2017, IEEE Transactions on Human-Machine Systems.

[50]  Natasha M. Maurits,et al.  Graphical Tasks to Measure Upper Limb Function in Patients With Parkinson's Disease: Validity and Response to Dopaminergic Medication , 2017, IEEE Journal of Biomedical and Health Informatics.

[51]  S. Sveinbjornsdottir.  The clinical symptoms of Parkinson's disease , 2016, Journal of neurochemistry.

[52]  Shao-Hsia Chang,et al.  Kinematic Analyses of Graphomotor Functions in Individuals with Alzheimer’s Disease and Amnestic Mild Cognitive Impairment , 2016 .

[53]  Réjean Plamondon,et al.  Development of a Sigma-Lognormal representation for on-line signatures , 2009, Pattern Recognit..

[54]  Francis Eustache,et al.  Characteristics and evolution of writing impairmant in Alzheimer's disease , 1993, Neuropsychologia.

[55]  G. Stelmach,et al.  Parkinsonian Patients Reduce Their Stroke Size with Increased Processing Demands , 2001, Brain and Cognition.

[56]  Clayton R. Pereira,et al.  A Step Towards the Automated Diagnosis of Parkinson's Disease: Analyzing Handwriting Movements , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[57]  Rüdiger W. Brause,et al.  Handwriting Analysis for Diagnosis and Prognosis of Parkinson's Disease , 2006, ISBMDA.

[58]  B Conrad,et al.  Changes in handwriting resulting from bilateral high‐frequency stimulation of the subthalamic nucleus in Parkinson's disease , 1999, Movement disorders : official journal of the Movement Disorder Society.

[59]  Jin H. Yan,et al.  Alzheimer's disease and mild cognitive impairment deteriorate fine movement control. , 2008, Journal of psychiatric research.

[60]  N. Arunkumar,et al.  Gait and tremor investigation using machine learning techniques for the diagnosis of Parkinson disease , 2018, Future Gener. Comput. Syst..

[61]  Sonia Kandel,et al.  Handwriting in patients with Parkinson disease: effect of L-dopa and stimulation of the sub-thalamic nucleus on motor anticipation. , 2011, Human movement science.

[62]  Christoph Laske,et al.  Diagnostic Value of a Tablet-Based Drawing Task for Discrimination of Patients in the Early Course of Alzheimer's Disease from Healthy Individuals. , 2016, Journal of Alzheimer's disease : JAD.

[63]  G. Stelmach,et al.  Hypometria and bradykinesia during drawing movements in individuals with Parkinson’s disease , 2009, Experimental Brain Research.

[64]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[65]  Giuseppe Pirlo,et al.  Multidomain Verification of Dynamic Signatures Using Local Stability Analysis , 2015, IEEE Transactions on Human-Machine Systems.

[66]  Michael C. Fairhurst,et al.  Computer analysis of handwriting dynamics during dopamimetic tests in Parkinson's disease , 2000, Proceedings of the 26th Euromicro Conference. EUROMICRO 2000. Informatics: Inventing the Future.

[67]  Marcos Faúndez-Zanuy,et al.  Evaluation of handwriting kinematics and pressure for differential diagnosis of Parkinson's disease , 2016, Artif. Intell. Medicine.

[68]  Lena Hartelius,et al.  Speech and Communication Changes Reported by People with Parkinson’s Disease , 2018, Folia Phoniatrica et Logopaedica.

[69]  Zdenek Smekal,et al.  Prediction potential of different handwriting tasks for diagnosis of Parkinson's , 2013, 2013 E-Health and Bioengineering Conference (EHB).

[70]  Lance M. Optican,et al.  Eye Movements in Parkinson’s Disease and Inherited Parkinsonian Syndromes , 2017, Front. Neurol..

[71]  Marcos Faúndez-Zanuy,et al.  Kinematic and Pressure Features of Handwriting and Drawing: Preliminary Results Between Patients with Mild Cognitive Impairment, Alzheimer Disease and Healthy Controls , 2017, Current Alzheimer research.

[72]  Trevor Archer,et al.  Dysgraphia in Relation to Cognitive Performance in Patients with Alzheimer’s Disease , 2013 .

[73]  Natasha M. Maurits,et al.  Standardized Handwriting to Assess Bradykinesia, Micrographia and Tremor in Parkinson's Disease , 2014, PloS one.

[74]  José Luis Contreras-Vidal,et al.  Neural dynamics of short and medium-term motor control effects of levodopa therapy in Parkinson's disease , 1998, Artif. Intell. Medicine.

[75]  Hans-Leo Teulings,et al.  Quantitative measurement of handwriting in the assessment of drug-induced parkinsonism. , 2006, Human movement science.

[76]  G. Stelmach,et al.  Control of stroke size, peak acceleration, and stroke duration in Parkinsonian handwriting , 1991 .

[77]  George E Stelmach,et al.  Motor learning and Parkinson’s disease: refinement of within-limb and between-limb coordination as a result of practice , 2000, Behavioural Brain Research.

[78]  G. Stelmach,et al.  Adaptation of handwriting size under distorted visual feedback in patients with Parkinson's disease and elderly and young controls , 2002, Journal of neurology, neurosurgery, and psychiatry.

[79]  Y Ben-Shlomo,et al.  Apathy in rapid eye movement sleep behaviour disorder is common and under‐recognized , 2017, European journal of neurology.

[80]  Tsui-Ying Wang,et al.  Progressive Micrographia Shown in Horizontal, but not Vertical, Writing in Parkinson’s Disease , 2013, Behavioural neurology.

[81]  M. Iturrate,et al.  Selection of entropy based features for the analysis of the Archimedes' spiral applied to essential tremor , 2015, 2015 4th International Work Conference on Bioinspired Intelligence (IWOBI).

[82]  P. Martínez-Martín,et al.  Unified Parkinson's disease rating scale characteristics and structure , 1994, Movement disorders : official journal of the Movement Disorder Society.

[83]  S. Borson,et al.  The Mini‐Cog: a cognitive ‘vital signs’ measure for dementia screening in multi‐lingual elderly , 2000, International journal of geriatric psychiatry.

[84]  Marcos Faúndez-Zanuy,et al.  Analysis of in-air movement in handwriting: A novel marker for Parkinson's disease , 2014, Comput. Methods Programs Biomed..

[85]  S. P. Swinnen,et al.  The effects of dual tasking on handwriting in patients with Parkinson’s disease , 2014, Neuroscience.

[86]  R. Plamondon,et al.  On the Use of the Sigma-Lognormal Model to Study Children Handwriting , 2013 .

[87]  Agostino Accardo,et al.  Kinematic Analysis of Handwriting in Parkinson Disease , 2017 .