An Approach to Measuring the Difficulty of Learning Activities

In any learning environment, training activities are the basis for learning. Students need to practice to develop new skills and improve previously acquired abilities. Each student has specific needs based on their previous knowledge and personal skills. The allocation of a proper activity for a particular student consists in selecting a training activity that fits the skills and knowledge of the student. This allocation is particularly important since students who are assigned a too hard training activity will tend to leave it rather than making the necessary effort to complete it. Moreover, when the activity is too easy it does not represent a challenge for the student and the learning outcomes will tend to be very limited. An motivating activity, suitable for a given student, should be neither too easy nor too difficult. The problem arises when trying to measure or estimate the difficulty given any training activity. Our proposal is a definition of difficulty of a learning activity that can be used to measure the learning cost of a general learner. As a first step, the desirable features and the intrinsic limitations of a difficulty function are identified, so that a mathematical definition can be obtained quite straightforward. The result is an intuitive, understandable and objectively measurable way to determine the difficulty of a learning activity.

[1]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[2]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[3]  Robin Hunicke,et al.  The case for dynamic difficulty adjustment in games , 2005, ACE '05.

[4]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[5]  Marco Roccetti,et al.  First person shooters on the road: Leveraging on APs and VANETs for a quality gaming experience , 2012, 2012 IFIP Wireless Days.

[6]  Jacob W. Getzets The Creative vision : a longitudinal study of problem finding in art / Jacob W. Getzels, Mihaly Csikszentmihalyi , 1976 .

[7]  Tobias Ley,et al.  Which User Interactions Predict Levels of Expertise in Work-Integrated Learning? , 2013, EC-TEL.

[8]  Jihie Kim,et al.  Can Online Discussion Participation Predict Group Project Performance? Investigating the Roles of Linguistic Features and Participation Patterns , 2013, International Journal of Artificial Intelligence in Education.

[9]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[10]  Stéphane Natkin,et al.  Scaling the Level of Difficulty in Single Player Video Games , 2009, ICEC.

[11]  Irene Cheng,et al.  An Algorithm for Automatic Difficulty Level Estimation of Multimedia Mathematical Test Items , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[12]  Fausto Mourato,et al.  Measuring Difficulty in Platform Videogames , 2010 .

[13]  Sanjit A. Seshia,et al.  Automating exercise generation: a step towards meeting the MOOC challenge for embedded systems , 2012, WESE '12.

[14]  Andrew Olney,et al.  Gaze tutor: A gaze-reactive intelligent tutoring system , 2012, Int. J. Hum. Comput. Stud..

[15]  Alvin Y. Wang,et al.  Characteristics of students who enroll and succeed in psychology Web-based classes. , 2000 .

[16]  Julian Togelius,et al.  Modeling player experience in Super Mario Bros , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[17]  M. Csíkszentmihályi Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[18]  Luisa M. Regueras,et al.  A distributed system for learning programming on-line , 2012, Comput. Educ..

[19]  Peter R. Turner,et al.  Predictive assessment of student performance for early strategic guidance , 2011, 2011 Frontiers in Education Conference (FIE).

[20]  Shihong Huang,et al.  Work in progress: A machine learning approach for assessment and prediction of teamwork effectiveness in software engineering education , 2012, 2012 Frontiers in Education Conference Proceedings.

[21]  Thomas Gärtner,et al.  Predicting Dynamic Difficulty , 2011, NIPS.

[22]  Joey J. Lee,et al.  Gamification in Education: What, How, Why Bother? , 2011 .