Toward Personalized Vibrotactile Support When Learning Motor Skills

Personal tracking technologies allow sensing of the physical activity carried out by people. Data flows collected with these sensors are calling for big data techniques to support data collection, integration and analysis, aimed to provide personalized support when learning motor skills through varied multisensorial feedback. In particular, this paper focuses on vibrotactile feedback as it can take advantage of the haptic sense when supporting the physical interaction to be learnt. Despite each user having different needs, when providing this vibrotactile support, personalization issues are hardly taken into account, but the same response is delivered to each and every user of the system. The challenge here is how to design vibrotactile user interfaces for adaptive learning of motor skills. TORMES methodology is proposed to facilitate the elicitation of this personalized support. The resulting systems are expected to dynamically adapt to each individual user’s needs by monitoring, comparing and, when appropriate, correcting in a personalized way how the user should move when practicing a predefined movement, for instance, when performing a sport technique or playing a musical instrument.

[1]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[2]  Gaetano Raiola Exergames and motor skills learning: a brief summary , 2012 .

[3]  Olga C. Santos Training the Body: The Potential of AIED to Support Personalized Motor Skills Learning , 2016, International Journal of Artificial Intelligence in Education.

[4]  Judy Kay,et al.  Preface to the special issue on ubiquitous user modeling and user-adapted interaction , 2015, User Modeling and User-Adapted Interaction.

[5]  Melanie Swan,et al.  The Quantified Self: Fundamental Disruption in Big Data Science and Biological Discovery , 2013, Big Data.

[6]  Benjamin Nye ITS, The End of the World as We Know It: Transitioning AIED into a Service-Oriented Ecosystem , 2016, International Journal of Artificial Intelligence in Education.

[7]  R. Bjork,et al.  Learning Versus Performance , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[8]  Christina Zong-Hao Ma,et al.  Balance Improvement Effects of Biofeedback Systems with State-of-the-Art Wearable Sensors: A Systematic Review , 2016, Sensors.

[9]  Jan O. Borchers,et al.  Wearable automatic feedback devices for physical activities , 2009, BODYNETS.

[10]  A.U. Alahakone,et al.  Vibrotactile feedback systems: Current trends in rehabilitation, sports and information display , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[11]  Olga C. Santos,et al.  Education Still Needs Artificial Intelligence to Support Personalized Motor Skill Learning: Aikido as a Case Study , 2015, AIED Workshops.

[12]  Olga C. Santos,et al.  Practical guidelines for designing and evaluating educationally oriented recommendations , 2015, Comput. Educ..

[13]  Jesus G. Boticario,et al.  An Open Sensing and Acting Platform for Context-Aware Affective Support in Ambient Intelligent Educational Settings , 2016, IEEE Sensors Journal.

[14]  Katherine J. Kuchenbecker,et al.  Effects of Vibrotactile Feedback on Human Learning of Arm Motions , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Gregory A. Brown,et al.  Wii, Kinect, and Move. Heart Rate, Oxygen Consumption, Energy Expenditure, and Ventilation due to Different Physically Active Video Game Systems in College Students , 2014, International journal of exercise science.

[16]  Galit Shmueli,et al.  Analyzing Behavioral Big Data: Methodological, practical, ethical, and moral issues , 2016 .

[17]  Karin Schwab,et al.  Toward A Theory Of Instruction , 2016 .

[18]  Chris Raymaekers Special issue on enactive interfaces , 2009, Interact. Comput..

[19]  Charles M. Reigeluth,et al.  Instructional-design Theories and Models : A New Paradigm of Instructional Theory, Volume II , 1999 .

[20]  Quan Z. Sheng,et al.  From Big Data to Big Service , 2015, Computer.

[21]  Xing-Dong Yang,et al.  Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises , 2015, CHI.

[22]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[23]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[24]  Norman I. Badler,et al.  Virtual Training via Vibrotactile Arrays , 2008, PRESENCE: Teleoperators and Virtual Environments.

[25]  Massimo Bergamasco,et al.  Real-Time Gesture Recognition, Evaluation and Feed-Forward Correction of a Multimodal Tai-Chi Platform , 2008, HAID.

[26]  Vuokko Lantz,et al.  Design of Dynamic Vibrotactile Textures , 2010, IEEE Transactions on Haptics.

[27]  Olga C. Santos,et al.  Emotions and Personality in Adaptive e-Learning Systems: An Affective Computing Perspective , 2017, Emotions and Personality in Personalized Services.

[28]  Olga C. Santos,et al.  Beyond Cognitive and Affective Issues: Designing Smart Learning Environments for Psychomotor Personalized Learning , 2016 .

[29]  Ramesh Raskar,et al.  Second Skin: Motion capture with actuated feedback for motor learning , 2010, VR.

[30]  Wei Fan,et al.  Mining big data: current status, and forecast to the future , 2013, SKDD.

[31]  P. Williams,et al.  Learning by Doing , 2004 .

[32]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[33]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[34]  Claude Cadoz,et al.  Enaction and Enactive Interfaces : A Handbook of terms , 2007 .

[35]  Stephen H. Fairclough,et al.  Construction of the biocybernetic loop: a case study , 2012, ICMI '12.

[36]  Erwin Schoonderwaldt,et al.  MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing , 2011, IEEE Transactions on Instrumentation and Measurement.