A Framework for the Creation of Leap Motion Gestural Interfaces for Handwriting Education to Children with Development Coordination Disorder

Gestural interfaced-based computational tools can be more suitable than other kinds of interfaces during calligraphy education to children with Developmental Coordination Disorder. The touchless tools reduce difficulties with handwriting of these pupils because they do not require physical contact and they dispense efforts of fine motor skills needed to perform calligraphy. They also serve as a motivational tool and they are more intuitive than touchscreen and graphical user interfaces. This paper deals with concepts of Development Coordination Disorder and human-computer interaction principles and it proposes a framework with a set of specific guidelines for software for the development of gestural interfaces for calligraphy education to children with DCD. Containing 25 guidelines in 3 stages – Prototyping, Development and Evaluation, this model takes into account the characteristics of DCD and recognizes fine motor skills technologies, relating all proposed guidelines to each other and supports the creation of appropriate gestural interfaces to assist these children at this school stage.

[1]  Edimo Sousa Silva.  Gesture Interaction and Evaluation Using the Leap Motion for Medical Visualization , 2015, SVR.

[2]  Edouard Gentaz,et al.  Analysis of cursive letters, syllables, and words handwriting in a French second-grade child with Developmental Coordination Disorder and comparison with typically developing children , 2014, Front. Psychol..

[3]  J. Ziviani,et al.  Can I Play Too? Physical Activity Engagement of Children with Developmental Coordination Disorders , 2004, Canadian journal of occupational therapy. Revue canadienne d'ergotherapie.

[4]  J. Albaret,et al.  Relationship Between Visual-Motor Integration, Eye-Hand Coordination, and Quality of Handwriting , 2009 .

[5]  J. Velay,et al.  Graphomotor skills in children with developmental coordination disorder (DCD): Handwriting and learning a new letter. , 2015, Human movement science.

[6]  D. Cabrol,et al.  Subtypes of Developmental Coordination Disorder: Research on Their Nature and Etiology , 2011, Developmental neuropsychology.

[7]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[8]  Kate Wilmut,et al.  An examination of writing pauses in the handwriting of children with developmental coordination disorder. , 2014, Research in developmental disabilities.

[9]  M. Smyth,et al.  Planning and execution of action in children with and without developmental coordination disorder. , 1997, Journal of child psychology and psychiatry, and allied disciplines.

[10]  John Morris,et al.  The Blank-Page Technique: Reinvigorating Paper Prototyping in Usability Testing , 2010, IEEE Transactions on Professional Communication.

[11]  Giorgia Mari,et al.  Phenotypic variability in developmental coordination disorder: Clustering of generalized joint hypermobility with attention deficit/hyperactivity disorder, atypical swallowing and narrative difficulties , 2015, American journal of medical genetics. Part C, Seminars in medical genetics.

[12]  Ahmed Lounis,et al.  Leap Motion Gesture Control With Carestream Software in the Operating Room to Control Imaging , 2015, Surgical innovation.

[13]  Jorge C. S. Cardoso,et al.  The Leap Motion movement for 2D pointing tasks: Characterisation and comparison to other devices , 2015, 2015 International Conference on Pervasive and Embedded Computing and Communication Systems (PECCS).

[14]  D. Sugden,et al.  Intervention approaches and children with developmental coordination disorder. , 1998, Pediatric rehabilitation.

[15]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[16]  Jill G. Zwicker,et al.  Developmental coordination disorder: a review and update. , 2012, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[17]  C. Missiuna,et al.  Early identification: are speech/language-impaired toddlers at increased risk for Developmental Coordination Disorder? , 2007, Child: care, health and development.

[18]  Tauseef Gulrez,et al.  Leap-Motion Based Online Interactive System for Hand Rehabilitation , 2015, HCI.

[19]  D. Maciver,et al.  Developmental Coordination Disorder: A synthesis of evidence to underpin an allied health professions' framework , 2008 .

[20]  C. Missiuna,et al.  Activities and participation in children with developmental coordination disorder: a systematic review. , 2011, Research in developmental disabilities.

[21]  R. Geuze.  Static balance and developmental coordination disorder. , 2003, Human movement science.

[22]  D. Sugden,et al.  Diagnosing developmental coordination disorders , 2013, Archives of Disease in Childhood.

[23]  B. McKenzie,et al.  Information processing deficits associated with developmental coordination disorder: a meta-analysis of research findings. , 1998, Journal of child psychology and psychiatry, and allied disciplines.

[24]  Luigi Gallo,et al.  Toward a Framework for Rapid Prototyping of Touchless User Interfaces , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[25]  M. Schoemaker,et al.  Developmental coordination disorder in children with specific language impairment: co-morbidity and impact on quality of life. , 2013, Research in developmental disabilities.

[26]  Andreas Butz,et al.  Sketch-a-TUI: low cost prototyping of tangible interactions using cardboard and conductive ink , 2012, Tangible and Embedded Interaction.

[27]  J. Piek,et al.  DCD and ADHD: a genetic study of their shared aetiology. , 2006, Human movement science.

[28]  D. Dewey,et al.  Identifying Developmental Coordination Disorder , 2001, Physical & occupational therapy in pediatrics.

[29]  Eliane Albuisson,et al.  Vertical and horizontal smooth pursuit eye movements in children with developmental coordination disorder , 2014, Developmental medicine and child neurology.

[30]  J. Summers,et al.  Activities of daily living in children with developmental coordination disorder: dressing, personal hygiene, and eating skills. , 2008, Human movement science.

[31]  B. Smits-Engelsman,et al.  Motor Learning: An Analysis of 100 Trials of a Ski Slalom Game in Children with and without Developmental Coordination Disorder , 2015, PloS one.

[32]  D. Sugden,et al.  Emerging adulthood in developmental co-ordination disorder: parent and young adult perspectives. , 2011, Research in developmental disabilities.

[33]  Björn Regnell,et al.  Development of Object-Oriented Frameworks , 1995 .

[34]  Shao-Hsia Chang,et al.  Characterization of motor control in handwriting difficulties in children with or without developmental coordination disorder , 2010, Developmental medicine and child neurology.

[35]  D. Sugden,et al.  Intervention in children with Developmental Coordination Disorder: the role of parents and teachers. , 2003, The British journal of educational psychology.

[36]  Jill G. Zwicker,et al.  Brain activation associated with motor skill practice in children with developmental coordination disorder: an fMRI study , 2011, International Journal of Developmental Neuroscience.

[37]  Ermioni Katartzi,et al.  Motivating children with developmental coordination disorder in school physical education: the self-determination theory approach. , 2011, Research in developmental disabilities.

[38]  Dong-Soo Kwon,et al.  Emotional interaction with a mobile robot using hand gestures , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[39]  Ehud Sharlin,et al.  Tangible user interfaces: Tools to examine, assess, and treat dynamic constructional processes in children with developmental coordination disorders , 2006 .

[40]  Geoffrey P. Bingham,et al.  Active Prospective Control Is Required for Effective Sensorimotor Learning , 2013, PloS one.

[41]  J. Bo,et al.  Motor skill learning in children with Developmental Coordination Disorder. , 2013, Research in developmental disabilities.

[42]  Sarit Tresser,et al.  Case Study: Using a Novel Virtual Reality Computer Game for Occupational Therapy Intervention , 2012, PRESENCE: Teleoperators and Virtual Environments.

[43]  Wendy Keay-Bright,et al.  Rotoscopy-Handwriting Prototype: Using Computer Animation Technique to Assist the Teaching of Handwriting for Children with Dyspraxia , 2011, 2011 Eighth International Conference on Information Technology: New Generations.

[44]  Ismar Frango Silveira,et al.  Ensino de Caligrafia para Dispráxicos utilizando Tecnologias Gestuais , 2015 .

[45]  Jean-Bernard Martens,et al.  Rehabilitation of handwriting skills in stroke patients using interactive games: a pilot study , 2009, CHI Extended Abstracts.

[46]  Wendy Keay-Bright,et al.  Using Rotoscopy Technique to Assist the Teaching of Handwriting for Children with Dyspraxia , 2010, 2010 Third International Conference on Advances in Computer-Human Interactions.

[47]  Thomas Bock,et al.  Intuitive and Adaptive Robotic Arm Manipulation using the Leap Motion Controller , 2014, ISR 2014.

[48]  Kate Wilmut,et al.  Handwriting speed in children with Developmental Coordination Disorder: are they really slower? , 2013, Research in developmental disabilities.

[49]  J Duysens,et al.  Fine motor deficiencies in children with developmental coordination disorder and learning disabilities: an underlying open-loop control deficit. , 2003, Human movement science.

[50]  M. Law,et al.  A Trajectory of Troubles , 2007, Physical & occupational therapy in pediatrics.

[51]  Karina Caro,et al.  Designing exergames combining the use of fine and gross motor exercises to support self-care activities , 2014, ASSETS.

[52]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[53]  L. Straker,et al.  Children With Developmental Coordination Disorder Play Active Virtual Reality Games Differently Than Children With Typical Development , 2014, Physical Therapy.

[54]  Deborah Dewey,et al.  Developmental coordination disorder: associated problems in attention, learning, and psychosocial adjustment. , 2002, Human movement science.

[55]  J. Zwicker,et al.  Neural Correlates of Developmental Coordination Disorder: A Review of Hypotheses , 2009, Journal of child neurology.

[56]  Jake Araullo,et al.  The Leap Motion controller: a view on sign language , 2013, OZCHI.

[57]  J. Ryan,et al.  Impact of task difficulty and motor ability on visual-motor task performance of children with and without developmental coordination disorder. , 2014, Human movement science.

[58]  J. Zwicker,et al.  Effect of internal versus external focus of attention on implicit motor learning in children with developmental coordination disorder. , 2015, Research in developmental disabilities.

[59]  S. Fong,et al.  Slowed muscle force production and sensory organization deficits contribute to altered postural control strategies in children with developmental coordination disorder. , 2013, Research in developmental disabilities.

[60]  J. Visser,et al.  Developmental coordination disorder: a review of research on subtypes and comorbidities. , 2003, Human movement science.

[61]  Gerhard Rinkenauer,et al.  Evaluation of the Leap Motion Controller as a New Contact-Free Pointing Device , 2014, Sensors.

[62]  Li-Chieh Kuo,et al.  Quantification of handwriting performance: Development of a force acquisition pen for measuring hand-grip and pen tip forces , 2013 .

[63]  Roger R. Hall,et al.  Prototyping for usability of new technology , 2001, Int. J. Hum. Comput. Stud..

[64]  T. Pietrangelo,et al.  The role of general dynamic coordination in the handwriting skills of children , 2015, Front. Psychol..

[65]  Geoffrey P. Bingham,et al.  A Sensorimotor Approach to the Training of Manual Actions in Children With Developmental Coordination Disorder , 2013, Journal of child neurology.

[66]  Lee Garber.  Gestural Technology: Moving Interfaces in a New Direction , 2013, Computer.

[67]  Andrzej Czyzewski,et al.  Multimodal human-computer interfaces based on advanced video and audio analysis , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[68]  R. Blank,et al.  Understanding performance deficits in developmental coordination disorder: a meta‐analysis of recent research , 2013, Developmental medicine and child neurology.

[69]  L. Magalhães,et al.  Bilateral coordination and motor sequencing in Brazilian children: preliminary construct validity and reliability analysis. , 2009, Occupational therapy international.

[70]  O Uso de Objetos de Aprendizagem com Alunos Surdos no Ensino Superior , 2014 .

[71]  Steinar Thorvaldsen,et al.  Digital dysfunctions in primary school: A pilot study , 2011, Comput. Educ..

[72]  Zhongke Wu,et al.  GPU-Based Realtime Hand Gesture Interaction and Rendering for Volume Datasets Using Leap Motion , 2014, 2014 International Conference on Cyberworlds.

[73]  Bouwien C M Smits-Engelsman,et al.  The impact of Wii Fit intervention on dynamic balance control in children with probable Developmental Coordination Disorder and balance problems. , 2014, Human movement science.

[74]  B C M Smits-Engelsman,et al.  The efficacy of two task-orientated interventions for children with Developmental Coordination Disorder: Neuromotor Task Training and Nintendo Wii Fit Training. , 2013, Research in developmental disabilities.

[75]  Rubita Sudirman,et al.  Aspects of a Standardized Automated System for Screening Children's Handwriting , 2011, 2011 First International Conference on Informatics and Computational Intelligence.

[76]  M. G. Wade,et al.  Variations in cognitive demand affect heart rate in typically developing children and children at risk for developmental coordination disorder. , 2015, Research in developmental disabilities.

[77]  Ioannis Tarnanas,et al.  Ecological Validity of Virtual Reality Daily Living Activities Screening for Early Dementia: Longitudinal Study , 2013, JMIR serious games.

[78]  Péter Szolgay,et al.  Exploring Direct 3D Interaction for Full Horizontal Parallax Light Field Displays Using Leap Motion Controller , 2015, Sensors.

[79]  Jeremy Sutton.  Air painting with Corel Painter Freestyle and the leap motion controller: a revolutionary new way to paint! , 2013, SIGGRAPH '13.

[80]  Ralph Johnson.  How to Design Frameworks , 1993, OOPSLA 1993.

[81]  E. Cohn,et al.  Social Participation for Children with Developmental Coordination Disorder , 2003, Physical & occupational therapy in pediatrics.

[82]  I. A. McKinlay,et al.  Understanding Developmental Dyspraxia: A Textbook For Students and Professionals , 2001 .

[83]  J. Jelsma,et al.  Using the ICF Framework to Explore the Multiple Interacting Factors Associated with Developmental Coordination Disorder , 2014, Current Developmental Disorders Reports.

[84]  Simone Diniz Junqueira Barbosa,et al.  Methods and tools: a method for evaluating the communicability of user interfaces , 2000, INTR.

[85]  Motohide Miyahara,et al.  Developmental dyspraxia and developmental coordination disorder , 1995, Neuropsychology Review.

[86]  H. Polatajko,et al.  Rites of passage: understanding participation of children with developmental coordination disorder. , 2003, Human movement science.

[87]  Karina Caro,et al.  Exergames for children with motor skills problems , 2014, ACM SIGACCESS Access. Comput..

[88]  H. Polatajko,et al.  Developmental coordination disorder (dyspraxia): an overview of the state of the art. , 2005, Seminars in pediatric neurology.