Towards the improvement of the cognitive, motoric and academic skills of students with special educational needs using Kinect learning games

There is an ongoing interest in developing motion Kinect-based learning games that are in accordance with intervention protocols for helping children with special educational needs. These games, which offer natural user interaction modalities, seem to be very beneficial for this population because of the combination of physical activities with cognitive-training tasks. There is still an open research issue about how to integrate such games into schools and how to organize systematic evaluation studies for showing their added value. This paper presents the positive findings of a pilot research study in inclusive classroom settings that were carried out at two primary schools with 20 children who have special educational needs and who used the Kinems suite that contains movement-based educational games for such children. Analysis of data gathered via pre- and post-test questionnaires, interviews and an in-depth study of kinetic and learning analytics showed that these games have a positive impact on childrens academic performance and improvement of their cognitive, motor and academic skills.

[1]  G. Gioia,et al.  Profiles of Everyday Executive Function in Acquired and Developmental Disorders , 2002, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[2]  Charles H Hillman,et al.  Impact of the FITKids Physical Activity Intervention on Adiposity in Prepubertal Children , 2014, Pediatrics.

[3]  Richard A. Schmidt,et al.  Motor Learning and Performance , 1991 .

[4]  Susan Goldin-Meadow,et al.  Embodied Learning Across the Life Span , 2012, Top. Cogn. Sci..

[5]  Michalinos Zembylas,et al.  The specters of bodies and affects in the classroom: a rhizo‐ethological approach , 2007 .

[6]  Ann L. Swartz,et al.  Wisdom, the Body, and Adult Learning: Insights from Neuroscience. , 2011 .

[7]  Eric B Hekler,et al.  "Alien Health Game": An Embodied Exergame to Instruct in Nutrition and MyPlate. , 2013, Games for health journal.

[8]  B. Pennington,et al.  Executive functions and developmental psychopathology. , 1996, Journal of child psychology and psychiatry, and allied disciplines.

[9]  Chronis Kynigos,et al.  Interactive Movement and Talk in Generating Meanings from Science , 2012 .

[10]  Baltasar Fernández-Manjón,et al.  Application of Learning Analytics in educational videogames , 2014, Entertain. Comput..

[11]  C. Pesce,et al.  Physical activity and mental performance in preadolescents: Effects of acute exercise on free-recall memory , 2009 .

[12]  Perry A. Zirkel,et al.  Scientifically Based Research and Peer-Reviewed Research under the IDEA: The Legal Definitions, Applications, and Implications. , 2009 .

[13]  Maria Roussou,et al.  Studying Player Experience in a Collaborative Embodied Interaction Game , 2011, 2011 Third International Conference on Games and Virtual Worlds for Serious Applications.

[14]  S. Pickering,et al.  The development of visuo-spatial working memory , 2001, Memory.

[15]  Maite Frutos-Pascual,et al.  Adaptive Tele-Therapies Based on Serious Games for Health for People with Time-Management and Organisational Problems: Preliminary Results , 2014, International journal of environmental research and public health.

[16]  Alf Inge Wang,et al.  Learning Recycling from Playing a Kinect Game , 2015, Int. J. Game Based Learn..

[17]  K. McGrew.  CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research , 2009 .

[18]  David F Stodden,et al.  Video game-based exercise, Latino children's physical health, and academic achievement. , 2013, American journal of preventive medicine.

[19]  Christopher Frauenberger,et al.  Developing technology for autism: an interdisciplinary approach , 2011, Personal and Ubiquitous Computing.

[20]  T. F. McLaughlin,et al.  EDUCATIONAL GAMES: A TECHNIQUE TO ACCELERATE THE ACQUISITION OF READING SKILLS OF CHILDREN WITH LEARNING DISABILITIES , 2005 .

[21]  Shing-Tsaan Huang,et al.  The Effects of Using Embodied Interactions to Improve Learning Performance , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[22]  Eunice Eunhee Jang,et al.  Investigating the effects of a game-based approach in teaching word recognition and spelling to students with reading disabilities and attention deficits , 2010 .

[23]  A. F. Kramer,et al.  The effect of acute treadmill walking on cognitive control and academic achievement in preadolescent children , 2009, Neuroscience.

[24]  R. Hepburn,et al.  BEING AND TIME , 2010 .

[25]  Charles H Hillman,et al.  The effects of an afterschool physical activity program on working memory in preadolescent children. , 2011, Developmental science.

[26]  T. C. Nicholas Graham,et al.  Designing action-based exergames for children with cerebral palsy , 2013, CHI.

[27]  Franca Garzotto,et al.  Exploring motion-based touchless games for autistic children's learning , 2013, IDC.

[28]  Laura Malinverni,et al.  Learning of Abstract Concepts through Full-Body Interaction: A Systematic Review , 2014, J. Educ. Technol. Soc..

[29]  J. Donnelly,et al.  Classroom-based physical activity, cognition, and academic achievement. , 2011, Preventive medicine.

[30]  Pedro Ribeiro,et al.  Acute coordinative exercise improves attentional performance in adolescents , 2008, Neuroscience Letters.

[31]  P. Tomporowski.  Effects of acute bouts of exercise on cognition. , 2003, Acta psychologica.

[32]  S. Retalis,et al.  Children with Motor Impairments Play a Kinect Learning Game: First Findings from a Pilot Case in an Authentic Classroom Environment , 2013, Interaction Design and Architecture(s).

[33]  R. Jordan.  Social Play and Autistic Spectrum Disorders , 2003, Autism : the international journal of research and practice.

[34]  George M. Jacobs,et al.  The Teacher's Sourcebook for Cooperative Learning: Practical Techniques, Basic Principles, and Frequently Asked Questions , 2002 .

[35]  Laura Malinverni,et al.  An inclusive design approach for developing video games for children with Autism Spectrum Disorder , 2017, Comput. Hum. Behav..

[36]  Eric Jensen,et al.  Teaching with the Brain in Mind , 1998 .

[37]  Matthew T Mahar,et al.  Effects of a classroom-based program on physical activity and on-task behavior. , 2006, Medicine and science in sports and exercise.

[38]  D. Murray,et al.  Attention, monotropism and the diagnostic criteria for autism , 2005, Autism.

[39]  Richard A. Schmidt,et al.  Motor learning and performance : a situation-based learning approach , 2008 .

[40]  Mirko Gelsomini,et al.  Designing and evaluating touchless playful interaction for ASD children , 2014, IDC.

[41]  Ella Shoval,et al.  Using mindful movement in cooperative learning while learning about angles , 2011 .

[42]  Jannicke Baalsrud Hauge,et al.  Implications of Learning Analytics for Serious Game Design , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[43]  Franca Garzotto,et al.  Touchless Motion-Based Interaction for Therapy of Autistic Children , 2014 .

[44]  Mari Huhtanen.  Kinetic kid – Guiding child interaction within a motion game , 2014 .

[45]  Martin V. Butz,et al.  Embodied learning of a generative neural model for biological motion perception and inference , 2015, Front. Comput. Neurosci..

[46]  J. Piaget,et al.  The origin of intelligence in the child , 1997 .

[47]  P. Naylor,et al.  School-based physical activity does not compromise children's academic performance. , 2007, Medicine and science in sports and exercise.

[48]  Laura Malinverni,et al.  The medium matters: the impact of full-body interaction on the socio-affective aspects of collaboration , 2015, IDC.

[49]  Caroline Savio-Ramos,et al.  "Alien Health": A Nutrition Instruction Exergame Using the Kinect Sensor. , 2014, Games for health journal.

[50]  Mirko Gelsomini,et al.  Designing motion-based activities to engage students with autism in classroom settings , 2015, IDC.

[51]  J M Stilwell.  The development of manual midline crossing in 2- to 6-year-old children. , 1987, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[52]  Dawn P. Flanagan,et al.  Essentials of Cross-Battery Assessment , 2000 .

[53]  Laura Malinverni,et al.  Impact of embodied interaction on learning processes: design and analysis of an educational application based on physical activity , 2012, IDC '12.

[54]  Jim M. Monti,et al.  Aerobic fitness enhances relational memory in preadolescent children: The FITKids randomized control trial , 2012, Hippocampus.

[55]  P. Anderson.  Assessment and Development of Executive Function (EF) During Childhood , 2002, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[56]  Hui-mei Justina Hsu.  The Potential of Kinect in Education , 2011 .