Training the Body: The Potential of AIED to Support Personalized Motor Skills Learning

This paper argues that the research field of Artificial Intelligence in Education (AIED) can benefit from integrating recent technological advances (e.g., wearable devices, big data processing, 3D modelling, 3D printing, ambient intelligence) and design methodologies, such as TORMES, when developing systems that address the psychomotor learning domain. In particular, the acquisition of motor skills could benefit from individualized instruction and support just as cognitive skills learning has over the last decades. To this point, procedural learning has been considered since the earliest days of AIED (dating back to the 1980’s). However, AIED developments in motor skills learning have lagged significantly behind. As technology has evolved, and supported by the do-it-yourself and quantified-self movements, it is now possible to integrate emerging interactive technologies in order to provide personal awareness and reflection for behavioural change at low cost and with low intrusion. Many activities exist that would benefit from personalizing motor skills learning, such as playing a musical instrument, handwriting, drawing, training for surgery, improving the technique in sports and martial arts, learning sign language, dancing, etc. In this context, my suggestions for AIED research in the coming 25 years focus on addressing challenges regarding 1) modelling the psychomotor interaction, and 2) providing appropriate personalized psychomotor support.

[1]  Marko Tkalcic,et al.  Emotions and Personality in Personalized Services , 2016, Human–Computer Interaction Series.

[2]  Olga C. Santos,et al.  Education Still Needs Artificial Intelligence to Support Personalized Motor Skill Learning: Aikido as a Case Study , 2015, AIED Workshops.

[3]  Stephen A. Brewster,et al.  Crosstrainer: testing the use of multimodal interfaces in situ , 2010, CHI.

[4]  Jesus G. Boticario,et al.  An Open Sensing and Acting Platform for Context-Aware Affective Support in Ambient Intelligent Educational Settings , 2016, IEEE Sensors Journal.

[5]  Deborah Lupton,et al.  Quantified Self , 2016, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[6]  Lucy E. Dunne,et al.  Overlock-Stitched Stretch Sensors: Characterization and Effect of Fabric Property , 2013 .

[7]  Paolo Bonato,et al.  Advances in wearable technology and applications in physical medicine and rehabilitation , 2005, Journal of NeuroEngineering and Rehabilitation.

[8]  Jerry Andriessen,et al.  Where is Education Heading and How About AI , 1999 .

[9]  Yoichi Takebayashi,et al.  Sound Feedback for Powerful Karate Training , 2004, NIME.

[10]  G. Wulf Attentional focus and motor learning: a review of 15 years , 2013 .

[11]  Olga C. Santos,et al.  Practical guidelines for designing and evaluating educationally oriented recommendations , 2015, Comput. Educ..

[12]  Jesus G. Boticario,et al.  The Full Life Cycle of Adaptation in aLFanet eLearning Environment , 2004 .

[13]  Hirokazu Taki,et al.  Development of Finger Motion Skill Learning Support System based on Data Gloves , 2014, KES.

[14]  Anita J. Harrow A taxonomy of the psychomotor domain : a guidefor developing behavioral objectives / by Anita J. Harrow , 1972 .

[15]  Myoungho Lee,et al.  Optimum conductive fabric sensor sites for evaluating the status of knee joint movements using bio-impedance , 2011, Biomedical engineering online.

[16]  Richard A. Magill,et al.  Motor Learning. Concepts and Applications , 1998 .

[17]  Karin Slegers,et al.  I would DiYSE for it!: a manifesto for do-it-yourself internet-of-things creation , 2012, NordiCHI.

[18]  R. Bjork,et al.  Learning Versus Performance , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[19]  Gerard Jounghyun Kim,et al.  Implementation and Evaluation of Just Follow Me: An Immersive, VR-Based, Motion-Training System , 2002, Presence: Teleoperators & Virtual Environments.

[20]  Celementina R. Russo,et al.  The Quantified Self , 2015, HCI.

[21]  Arnold Baca,et al.  Rapid Feedback Systems for Elite Sports Training , 2006, IEEE Pervasive Computing.

[22]  T. Furness,et al.  Perception of virtual auditory shapes , 1994 .

[23]  Stellan Ohlsson,et al.  Learning to do and learning to understand : a lesson and a challenge for cognitive modeling , 1996 .

[24]  Sébastien Marcel,et al.  Gestures for Multi-Modal Interfaces: A Review , 2002 .

[25]  Toni Giorgino,et al.  Sensor Evaluation for Wearable Strain Gauges in Neurological Rehabilitation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[27]  Tilak Dias,et al.  Automatic identification of gait events using an instrumented sock , 2011, Journal of NeuroEngineering and Rehabilitation.

[28]  P. Castiglioni,et al.  Advancements in the Monitoring of Cardiorespiratory Function in Active People by Textile Technology , 2009 .

[29]  Göteborg,et al.  Individualising Surgical Training in a Virtual Haptic Environment , 2005 .

[30]  Jeffrey B. O’Brien,et al.  The effects of positive versus negative feedback on information-integration category learning , 2007, Perception & psychophysics.

[31]  Arthur A. Eggert,et al.  A rebuttal to A role for AI in education: using technology to reshape education , 1990 .

[32]  Katie A. Siek,et al.  MuscleMemory: Identifying the scope of wearable technology in high intensity exercise communities , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[33]  Alex Paramythis,et al.  A Decomposition Model for the Layered Evaluation of Interactive Adaptive Systems , 2005, User Modeling.

[34]  J. Bruner The course of cognitive growth. , 1964 .

[35]  Marc Cavazza,et al.  Narrative Balance Management in an Intelligent Biosafety Training Application for Improving User Performance , 2014, International Journal of Artificial Intelligence in Education.

[36]  Daniel Tik-Pui Fong,et al.  The Use of Wearable Inertial Motion Sensors in Human Lower Limb Biomechanics Studies: A Systematic Review , 2010, Sensors.

[37]  Olga C. Santos,et al.  Emotions and Personality in Adaptive e-Learning Systems: An Affective Computing Perspective , 2017, Emotions and Personality in Personalized Services.

[38]  Roger C. Schank,et al.  A role for AI in education: using technology to reshape education , 1989 .

[39]  Judith Masthoff,et al.  Layered evaluation of interactive adaptive systems: framework and formative methods , 2010, User Modeling and User-Adapted Interaction.

[40]  Pierre Nonnon,et al.  Robot-based pedagogy , 1990 .

[41]  F. Lorussi,et al.  Modeling and Characterization of Extensible Wearable Textile-Based Electrogoniometers , 2013, IEEE Sensors Journal.

[42]  Hirokazu Taki,et al.  Development of a Gesture Learning Environment for Novices' Erhu Bow Strokes , 2014, KES.

[43]  Tom Chau,et al.  E-textiles in Clinical Rehabilitation: A Scoping Review , 2015 .

[44]  Qiao Li,et al.  In-Shoe Plantar Pressure Measurement and Analysis System Based on Fabric Pressure Sensing Array , 2010, IEEE Transactions on Information Technology in Biomedicine.

[45]  Peter van Rosmalen,et al.  Augmenting the Senses: A Review on Sensor-Based Learning Support , 2015, Sensors.

[46]  Markus H. Gross,et al.  Combining body sensors and visual sensors for motion training , 2005, ACE '05.

[47]  James Stephens,et al.  Postural improvement using core integration to lengthen myofascia. , 2008, Journal of bodywork and movement therapies.

[48]  P. Rabardel,et al.  Activity with a training robot and the formation of knowledge , 1991 .

[49]  Gerhard Tröster,et al.  Combining electronics on flexible plastic strips with textiles , 2013 .

[50]  Dan Eltringham,et al.  from 'Forced Fingers' , 2015 .

[51]  Antonija Mitrovic,et al.  Intelligent Augmented Reality Training for Motherboard Assembly , 2015, International Journal of Artificial Intelligence in Education.

[52]  J. Krakauer,et al.  Consolidation of motor memory , 2006, Trends in Neurosciences.

[53]  Hassan Ghasemzadeh,et al.  Wearable coach for sport training: A quantitative model to evaluate wrist-rotation in golf , 2009, J. Ambient Intell. Smart Environ..

[54]  Alexandru Dancu,et al.  Motor learning in a mixed reality environment , 2012, NordiCHI.

[55]  Gerhard Tröster,et al.  Estimating Posture-Recognition Performance in Sensing Garments Using Geometric Wrinkle Modeling , 2010, IEEE Transactions on Information Technology in Biomedicine.

[56]  Paul Fergus,et al.  Body Area Networks for Movement Analysis in Physiotherapy Treatments , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[57]  M. Tomizuka,et al.  A network-based monitoring system for rehabilitation , 2012, 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[58]  K. Hata,et al.  A stretchable carbon nanotube strain sensor for human-motion detection. , 2011, Nature nanotechnology.

[59]  Rajiv Padhye,et al.  Sewability of air-jet textured sewing threads in denim , 2013 .

[60]  Olga C. Santos,et al.  Beyond Cognitive and Affective Issues: Designing Smart Learning Environments for Psychomotor Personalized Learning , 2016 .

[61]  Ramesh Raskar,et al.  Second Skin: Motion capture with actuated feedback for motor learning , 2010, VR.

[62]  Peter Wolf,et al.  A virtual trainer concept for robot-assisted human motor learning in rowing , 2011 .

[63]  Leslie J. Briggs,et al.  Principles of Instructional Design , 1974 .

[64]  Massimo Bergamasco,et al.  Real-Time Gesture Recognition, Evaluation and Feed-Forward Correction of a Multimodal Tai-Chi Platform , 2008, HAID.

[65]  Olga C. Santos,et al.  Toward interactive context-aware affective educational recommendations in computer-assisted language learning , 2016, New Rev. Hypermedia Multim..

[66]  Dennis Arsenault,et al.  A Quaternion-Based Motion Tracking and Gesture Recognition System Using Wireless Inertial Sensors , 2014 .

[67]  Yvonne Rogers,et al.  Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback , 2011, CHI.

[68]  Yu-Pin Lin,et al.  Environments: A New Cutting-Edge International and Interdisciplinary Scholarly Open Access Journal , 2014 .

[69]  Jan O. Borchers,et al.  Real-time snowboard training system , 2008, CHI Extended Abstracts.

[70]  Silvana Quaglini,et al.  Estimation of human trunk movements by wearable strain sensors and improvement of sensor’s placement on intelligent biomedical clothes , 2012, Biomedical engineering online.

[71]  Michael J. Baker,et al.  The roles of models in Artificial Intelligence and Education research: a prospective view , 2000 .

[72]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[73]  Hiroaki Nishino,et al.  A 3D Editing Method with Hand Gesture Using Sound Information , 2014, 2014 Eighth International Conference on Complex, Intelligent and Software Intensive Systems.

[74]  Norman I. Badler,et al.  Virtual Training via Vibrotactile Arrays , 2008, PRESENCE: Teleoperators and Virtual Environments.

[75]  Olga C. Santos,et al.  Requirements for Semantic Educational Recommender Systems in Formal E-Learning Scenarios , 2011, Algorithms.

[76]  Robert A. Bjork,et al.  A new theory of disuse and an old theory of stimulus fluctuation , 1992 .

[77]  Benjamin Nye,et al.  AIED Is Splitting Up (Into Services) and the Next Generation Will Be All Right , 2015, AIED Workshops.

[78]  Wei Fan,et al.  Mining big data: current status, and forecast to the future , 2013, SKDD.

[79]  D.A. James,et al.  Investigating the translational and rotational motion of the swing using accelerometers for athlete skill assessment , 2006, 2006 5th IEEE Conference on Sensors.

[80]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[81]  David V. Thiel,et al.  An unobtrusive swimming monitoring system for recreational and elite performance monitoring , 2011 .

[82]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[83]  Peter Wolf,et al.  The effect of haptic guidance and visual feedback on learning a complex tennis task , 2013, Experimental Brain Research.

[84]  Tanja Schultz,et al.  Airwriting: a wearable handwriting recognition system , 2013, Personal and Ubiquitous Computing.

[85]  C. Shea,et al.  Motor skill learning and performance: a review of influential factors , 2010, Medical education.