Recent developments in the study of rapid human movements with the kinematic theory: Applications to handwriting and signature synthesis

Human movement modeling can be of great interest for the design of pattern recognition systems relying on the understanding of the fine motor control (such as on-line handwriting recognition or signature verification) as well as for the development of intelligent systems involving in a way or another the processing of human movements. In this paper, we briefly list the different models that have been proposed in order to characterize the handwriting process and focus on a representation involving a vectorial summation of lognormal functions: the Sigma-lognormal model. Then, from a practical perspective, we describe a new stroke extraction algorithm suitable for the reverse engineering of handwriting signals. In the following section it is shown how the resulting representation can be used to study the writer and signer variability. We then report on two joint projects dealing with the automatic generation of synthetic specimens for the creation of large databases. The first application concerns the automatic generation of totally synthetic signature specimens for the training and evaluation of verification performances of automatic signature recognition systems. The second application deals with the synthesis of handwritten gestures for speeding up the learning process in customizable on-line recognition systems to be integrated in electronic pen pads.

[1]  F. J. Maarse The study of handwriting movement: peripheral models and signal processing techniques , 1987 .

[2]  Réjean Plamondon,et al.  Learning handwriting with pen-based systems: computational issues , 2002, Pattern Recognit..

[3]  Pietro Morasso,et al.  How a discontinuous mechanism can produce continuous patterns in trajectory formation and handwriting , 1983 .

[4]  Rama Chellappa,et al.  Synthetic Fingerprint Generation , 2009, Encyclopedia of Biometrics.

[5]  Ning Qian,et al.  An optimization principle for determining movement duration. , 2006, Journal of neurophysiology.

[6]  Julian Fiérrez,et al.  HMM-based on-line signature verification: Feature extraction and signature modeling , 2007, Pattern Recognit. Lett..

[7]  Seiichi Uchida,et al.  Online character recognition based on elastic matching and quadratic discrimination , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[8]  Arun Ross,et al.  Handbook of Biometrics , 2007 .

[9]  A. Alimi Beta neuro-fuzzy systems , 2003 .

[10]  Arun Ross,et al.  Generating Synthetic Irises by Feature Agglomeration , 2006, 2006 International Conference on Image Processing.

[11]  Seiichi Uchida,et al.  Online Character Recognition Based on Elastic Matching , 2005 .

[12]  J. W. Wolfe,et al.  Time-Optimal Control of Saccadic Eye Movements , 1987, IEEE Transactions on Biomedical Engineering.

[13]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Réjean Plamondon,et al.  The Design of An On-Line Signature Verification System: From Theory to Practice , 1994, Int. J. Pattern Recognit. Artif. Intell..

[15]  Stephen Grossberg,et al.  A neural model of cortico-cerebellar interactions during attentive imitation and predictive learning of sequential handwriting movements , 2000, Neural Networks.

[16]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[17]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[18]  Zhouchen Lin,et al.  Style-preserving English handwriting synthesis , 2007, Pattern Recognit..

[19]  Seiichiro Hangai,et al.  Signature Features , 2015, Encyclopedia of Biometrics.

[20]  Berrin A. Yanikoglu,et al.  Identity authentication using improved online signature verification method , 2005, Pattern Recognit. Lett..

[21]  Réjean Plamondon,et al.  A kinematic theory of rapid human movement. Part IV: a formal mathematical proof and new insights , 2003, Biological Cybernetics.

[22]  Sascha E. Engelbrecht,et al.  Minimum Principles in Motor Control. , 2001, Journal of mathematical psychology.

[23]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[24]  E. Bizzi,et al.  Effect of load disturbances during centrally initiated movements. , 1978, Journal of neurophysiology.

[25]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[26]  Leclerc,et al.  4 - Des gaussiennes pour la modélisation des signatures et la segmentation de tracés manuscrits , 1992 .

[27]  Javier Garrido Salas,et al.  BiosecurID: a multimodal biometric database , 2009, Pattern Analysis and Applications.

[28]  Réjean Plamondon,et al.  A New Methodology to Improve Myoelectric Signal Processing Using Handwriting , 2008 .

[29]  Christian O'Reilly,et al.  Prototype-Based Methodology for the Statistical Analysis of Local Features in Stereotypical Handwriting Tasks , 2010, 2010 20th International Conference on Pattern Recognition.

[30]  Claudio M. Privitera,et al.  A neural model for generating and learning a rapid movement sequence , 1996, Biological Cybernetics.

[31]  R. Plamondon,et al.  A multi-level representation paradigm for handwriting stroke generation. , 2006, Human movement science.

[32]  Réjean Plamondon,et al.  Development of a Sigma-Lognormal representation for on-line signatures , 2009, Pattern Recognit..

[33]  Anil K. Jain,et al.  Performance evaluation of fingerprint verification systems , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Seiichiro Hangai,et al.  Signature Matching , 2015, Encyclopedia of Biometrics.

[35]  C. O'Reilly,et al.  A software assistant for the design and analysis of neuromuscular tests , 2007, 2007 IEEE Biomedical Circuits and Systems Conference.

[36]  Shimon Edelman,et al.  A model of handwriting , 2004, Biological Cybernetics.

[37]  S. Athènes,et al.  Switching among graphic patterns is governed by coordination dynamics of handwriting , 2006 .

[38]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[39]  Harry Shum,et al.  Combining shape and physical modelsfor online cursive handwriting synthesis , 2004, International Journal of Document Analysis and Recognition (IJDAR).

[40]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[41]  R Plamondon,et al.  Speed/accuracy trade-offs in target-directed movements , 1997, Behavioral and Brain Sciences.

[42]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[43]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[44]  Éric Anquetil,et al.  Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers , 2011, Evol. Syst..

[45]  Anil K. Jain,et al.  Synthetic Fingerprint Generation , 2009, Encyclopedia of Biometrics.

[46]  J. J. Denier,et al.  The guiding of human writing movements , 1965, Kybernetik.

[47]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 2004, Biological Cybernetics.

[49]  Mitsuo Kawato,et al.  A theory for cursive handwriting based on the minimization principle , 1995, Biological Cybernetics.

[50]  V. Srinivasa Chakravarthy,et al.  An oscillatory neuromotor model of handwriting generation , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[51]  M. D. Neilson,et al.  An overview of adaptive model theory: solving the problems of redundancy, resources, and nonlinear interactions in human movement control , 2005, Journal of neural engineering.

[52]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[53]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[54]  Julian Fierrez,et al.  Synthetic generation of handwritten signatures based on spectral analysis , 2009, Defense + Commercial Sensing.

[55]  D. Bushaw,et al.  Functional analysis and time optimal control , 1972 .

[56]  R. Plamondon,et al.  Automatic Extraction of Sigma-Lognormal Parameters on Signatures , 2008 .

[57]  YanikogluBerrin,et al.  Identity authentication using improved online signature verification method , 2005 .

[58]  R Plamondon,et al.  Studying the variability of handwriting patterns using the Kinematic Theory. , 2009, Human movement science.

[59]  Stephen Grossberg,et al.  The Vite Model: A Neural Command Circuit for Generating Arm and Articulator Trajectories, , 1988 .

[60]  Laurent Miclet,et al.  Synthetic On-line Handwriting Generation by Distortions and Analogy , 2007 .

[61]  R. Plamondon,et al.  Impact of the principal stroke risk factors on human movements. , 2011, Human movement science.

[62]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[63]  R. Plamondon,et al.  Kinematic characteristics of bidirectional delta-lognormal primitives in young and older subjects. , 2011, Human movement science.

[64]  P D Neilson,et al.  The problem of redundancy in movement control: The adaptive model theory approach , 1993, Psychological research.

[65]  Natalia A. Schmid,et al.  On Generation and Analysis of Synthetic Iris Images , 2007, IEEE Transactions on Information Forensics and Security.

[66]  C. O'Reilly Développement d'outils d’analyse de la motricité fine pour l’investigation de troubles neuromusculaires : théorie, prototype et mise en application dans le contexte des accidents vasculaires cérébraux , 2012 .

[67]  Réjean Plamondon,et al.  Modelization of Handwriting: A System Approach , 1986 .

[68]  Gerard P. van Galen,et al.  The independent monitoring of form and scale factors in handwriting , 1983 .

[69]  Réjean Plamondon,et al.  A New Algorithm and System for the Characterization of Handwriting Strokes with Delta-Lognormal Parameters , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  J. Hollerbach An oscillation theory of handwriting , 2004, Biological Cybernetics.

[71]  Lambert Schomaker Simulation and recognition of handwriting movements: a vertical approach to modeling human motor behavior , 1991 .

[72]  Christian O'Reilly,et al.  Design of a neuromuscular disorders diagnostic system using human movement analysis , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[73]  M. Latash,et al.  Testing hypotheses and the advancement of science: recent attempts to falsify the equilibrium point hypothesis , 2005, Experimental Brain Research.

[74]  Réjean Plamondon,et al.  The generation of handwriting with delta-lognormal synergies , 1998, Biological Cybernetics.

[75]  R. F. Brown,et al.  PERFORMANCE EVALUATION , 2019, ISO 22301:2019 and business continuity management – Understand how to plan, implement and enhance a business continuity management system (BCMS).

[76]  Réjean Plamondon,et al.  Extraction of delta-lognormal parameters from handwriting strokes , 2007, Frontiers of Computer Science in China.

[77]  E. H. Dooijes Analysis of handwriting movements , 1983 .