An automated assessment system for embodied cognition in children: from motion data to executive functioning

We present our preliminary data analysis towards an automated assessment system for the Activate Test for Embodied Cognition (ATEC), a test which measures cognitive skills through physical activity. More specifically, we present two core ATEC tasks designed to assess attention, working memory, response inhibition, rhythm and coordination in children: the Sailor Step and the Ball-Drop-to-the-Beat task. These tasks are specifically designed to assess lower and upper body accuracy, response inhibition and rhythm. Motion data were collected through the Kinect camera. This paper presents an overview of the assessment tasks, the data collection, and annotation with a preliminary analysis towards an automated scoring system through machine learning and computer vision methods.

[1]  Nicola J. Pitchford,et al.  The interrelation between cognitive and motor development in typically developing children aged 4-11 years is underpinned by visual processing and fine manual control. , 2011, British journal of psychology.

[2]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Cewu Lu,et al.  RMPE: Regional Multi-person Pose Estimation , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Thomas Serre,et al.  HMDB: A large video database for human motion recognition , 2011, 2011 International Conference on Computer Vision.

[5]  Konstantinos Tsiakas,et al.  Towards an automated assessment for embodied cognition in children: the sailor step task , 2019, PETRA.

[6]  C. Davis,et al.  Fitness, fatness, cognition, behavior, and academic achievement among overweight children: do cross-sectional associations correspond to exercise trial outcomes? , 2011, Preventive medicine.

[7]  Cordelia Schmid,et al.  Actions in context , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Alberto Del Bimbo,et al.  Submitted to Ieee Transactions on Cybernetics 1 3d Human Action Recognition by Shape Analysis of Motion Trajectories on Riemannian Manifold , 2022 .

[9]  J. Donnelly,et al.  Classroom-based physical activity, cognition, and academic achievement. , 2011, Preventive medicine.

[10]  B. Pennington,et al.  Validity of the Executive Function Theory of Attention-Deficit/Hyperactivity Disorder: A Meta-Analytic Review , 2005, Biological Psychiatry.

[11]  Sandra Weintraub,et al.  II. NIH Toolbox Cognition Battery (CB): measuring executive function and attention. , 2013, Monographs of the Society for Research in Child Development.

[12]  Michael S. Ryoo,et al.  Fine-Grained Activity Recognition in Baseball Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  R. Malina,et al.  Physical Activity and Inactivity Among Children and Adolescents: Assessment, Trends, and Correlates , 2016 .

[14]  Lianwen Jin,et al.  Skeleton-based Gesture Recognition Using Several Fully Connected Layers with Path Signature Features and Temporal Transformer Module , 2018, AAAI.

[15]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  R. Palisano,et al.  Assessment of motor development and function in preschool children. , 2005, Mental retardation and developmental disabilities research reviews.

[17]  Stuart Corbridge,et al.  Challenges for development , 2000 .

[18]  Mubarak Shah,et al.  UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild , 2012, ArXiv.

[19]  Hermann Ney,et al.  RWTH-PHOENIX-Weather: A Large Vocabulary Sign Language Recognition and Translation Corpus , 2012, LREC.

[20]  A. Stiffman.  A Brief Measure of Children's Behavior Problems: The Behavior Rating Index for Children. , 1984 .

[21]  T. Achenbach,et al.  The Child Behavior Checklist and related forms for assessing behavioral/emotional problems and competencies. , 2000, Pediatrics in review.

[22]  Graham W. Taylor,et al.  Real-Time End-to-End Action Detection with Two-Stream Networks , 2018, 2018 15th Conference on Computer and Robot Vision (CRV).

[23]  Xiaowei Zhou,et al.  Learning to Estimate 3D Human Pose and Shape from a Single Color Image , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Megan M. McClelland,et al.  Self‐regulation in early childhood: Improving conceptual clarity and developing ecologically valid measures. , 2012 .

[25]  Stan Sclaroff,et al.  Challenges in development of the American Sign Language Lexicon Video Dataset (ASLLVD) corpus , 2012 .

[26]  Cordelia Schmid,et al.  Actions in context , 2009, CVPR.

[27]  Joseph J. LaViola,et al.  DeepGRU: Deep Gesture Recognition Utility , 2018, ISVC.

[28]  Joseph J. LaViola,et al.  A Rapid Prototyping Approach to Synthetic Data Generation for Improved 2D Gesture Recognition , 2016, UIST.

[29]  Jing Zhang,et al.  RGB-D-based action recognition datasets: A survey , 2016, Pattern Recognit..

[30]  R. Pinjatela.  SELF-REGULATION IN EARLY CHILDHOOD , 2012 .