Regulating distance to the screen while engaging in difficult tasks

Regulation of distance to the screen (i.e., head-to-screen distance, fluctuation of head-to-screen distance) has been proved to reflect the cognitive engagement of the reader. However, it is still not clear (a) whether regulation of distance to the screen can be a potential parameter to infer high cognitive load and (b) whether it can predict the upcoming answer accuracy. Configuring tablets or other learning devices in a way that distance to the screen can be analyzed by the learning software is in close reach. The software might use the measure as a person-specific indicator of need for extra scaffolding. In order to better gauge this potential, we analyzed eye-tracking data of children (N = 144, Mage = 13 years, SD = 3.2 years) engaging in multimedia learning, as distance to the screen is estimated as a by-product of eye tracking. Children were told to maintain a still seated posture while reading and answering questions at three difficulty levels (i.e., easy vs. medium vs. difficult). Results yielded that task difficulty influences how well the distance to the screen can be regulated, supporting that regulation of distance to the screen is a promising measure. Closer head-to-screen distance and larger fluctuation of head-to-screen distance can reflect that participants are engaging in a challenging task. Only large fluctuation of head-to-screen distance can predict the future incorrect answers. The link between distance to the screen and processing of cognitive task can obtrusively embody reader’s cognitive states during system usage, which can support adaptive learning and testing.

[1]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[2]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[3]  Wim Dankaerts,et al.  Effect of Different Upright Sitting Postures on Spinal-Pelvic Curvature and Trunk Muscle Activation in a Pain-Free Population , 2006, Spine.

[4]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[5]  O. Faude,et al.  Jeopardizing Christmas: Why spoiled kids and a tight schedule could make Santa Claus fall? , 2015, Gait & posture.

[6]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[7]  Roy Stripling,et al.  Postural Control as a Probe for Cognitive State: Exploiting Human Information Processing to Enhance Performance , 2004, Int. J. Hum. Comput. Interact..

[8]  Fang Zhao,et al.  Eye Tracking Indicators of Reading Approaches in Text-Picture Comprehension , 2014 .

[9]  M Hegarty,et al.  Mental animation in the visuospatial sketchpad: Evidence from dual-task studies , 1997, Memory & cognition.

[10]  Thierry Baccino,et al.  Fluctuation in Cognitive Engagement During Reading: Evidence From Concurrent Recordings of Postural and Eye Movements , 2018, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Rossana de Beni,et al.  Visuospatial working memory in learning from multimedia systems , 2000, J. Comput. Assist. Learn..

[12]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[13]  Interference between postural control and spatial vs. non-spatial auditory reaction time tasks in older adults. , 2015, Journal of vestibular research : equilibrium & orientation.

[14]  Matthew T. McCrudden,et al.  Relevance and Goal-Focusing in Text Processing , 2007 .

[15]  Gottfried Zimmermann,et al.  Adaptive multimedia: Using gaze-contingent instructional guidance to provide personalized processing support , 2019, Comput. Educ..

[16]  Silvia Conforto,et al.  The development of postural strategies in children: a factorial design study , 2005, Journal of NeuroEngineering and Rehabilitation.

[17]  G. Dreisbach,et al.  The influence of negative stimulus features on conflict adaption: evidence from fluency of processing , 2015, Front. Psychol..

[18]  M. Woollacott,et al.  Cognitive influence on postural stability: a neuromuscular analysis in young and older adults. , 2000, The journals of gerontology. Series A, Biological sciences and medical sciences.

[19]  Christian Gütl,et al.  AdELE: A Framework for Adaptive E-Learning through Eye Tracking , 2004 .

[20]  P. Patel,et al.  Attentional Demands of Perturbation Evoked Compensatory Stepping Responses: Examining Cognitive-Motor Interference to Large Magnitude Forward Perturbations , 2015, Journal of motor behavior.

[21]  J. Hyönä,et al.  Eye movements during repeated reading of a text. , 1990, Acta psychologica.

[22]  Alexander Eitel,et al.  Identifying processes underlying the multimedia effect in testing: An eye-movement analysis , 2017 .

[23]  A. Glenberg,et al.  On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies , 1994, Memory & cognition.

[24]  Anne Shumway-Cook,et al.  Selective utilization of spatial working memory resources during stance posture , 2005, Neuroreport.

[25]  Stéphane Baudry,et al.  Functional Synergy Between Postural and Visual Behaviors When Performing a Difficult Precise Visual Task in Upright Stance , 2017, Cogn. Sci..

[26]  C D Wickens,et al.  Principles of S-C-R Compatibility with Spatial and Verbal Tasks: The Role of Display-Control Location and Voice-Interactive Display-Control Interfacing , 1984, Human factors.

[27]  Jing Qiu,et al.  Body Posture as an Indicator of Workload in Mental Work , 2012, Hum. Factors.

[28]  G. L. Pellecchia,et al.  Postural sway increases with attentional demands of concurrent cognitive task. , 2003, Gait & posture.

[29]  M. Woollacott,et al.  Walking in high-risk settings: Do older adults still prioritize gait when distracted by a cognitive task? , 2014, Experimental Brain Research.

[30]  Robert Gaschler,et al.  More Than Hitting the Correct Key Quickly. , 2019, Experimental psychology.

[31]  A. Paivio Mental Representations: A Dual Coding Approach , 1986 .

[32]  Nicolas Debue,et al.  What does germane load mean? An empirical contribution to the cognitive load theory , 2014, Front. Psychol..

[33]  Y. Liu,et al.  Selective Effects of Postural Control on Spatial vs. Nonspatial Working Memory: A Functional Near-Infrared Spectral Imaging Study , 2018, Front. Hum. Neurosci..

[34]  W. Schnotz,et al.  Construction and Elaboration of Mental Models Through Strategic Conjoint Processing of Text and Pictures , 2018 .

[35]  Karen V Richards,et al.  The Effect of Different Standing and Sitting Postures on Trunk Muscle Activity in a Pain-Free Population , 2002, Spine.

[36]  B. Kerr,et al.  Cognitive spatial processing and the regulation of posture. , 1985, Journal of experimental psychology. Human perception and performance.

[37]  M. Rapp,et al.  Age-Related Interference between the Selection of Input-Output Modality Mappings and Postural Control—a Pilot Study , 2017, Front. Psychol..

[38]  Marjorie H. Woollacott,et al.  Non-visual spatial tasks reveal increased interactions with stance postural control , 2008, Brain Research.

[39]  W. Schnotz,et al.  Texts and pictures serve different functions in conjoint mental model construction and adaptation , 2019, Memory & Cognition.

[40]  Jan Theeuwes,et al.  Top-down and bottom-up control of visual selection: controversies and debate , 2010 .

[41]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[42]  M. Woollacott,et al.  Interaction Between the Development of Postural Control and the Executive Function of Attention , 2008, Journal of motor behavior.

[43]  W. Young,et al.  Cognitively and socially induced stress affects postural control , 2017, Experimental Brain Research.

[44]  I. Koch,et al.  When two actions are easier than one: how inhibitory control demands affect response processing. , 2014, Acta psychologica.

[45]  S. Katsuno,et al.  Changes with aging in head and center of foot pressure sway in children. , 1994, International journal of pediatric otorhinolaryngology.

[46]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[47]  W. Sommer,et al.  The influence of emotion type, social value orientation and processing focus on approach-avoidance tendencies to negative dynamic facial expressions , 2017 .

[48]  M. Hoshiyama,et al.  Effect of Cognitive Load on Seating Posture in Children. , 2016, Occupational therapy international.

[49]  P. Johnson-Laird,et al.  Visual imagery can impede reasoning , 2002, Memory & cognition.

[50]  Valérie Gyselinck,et al.  Visuospatial memory and phonological loop in learning from multimedia , 2002 .

[51]  Shannon Carey,et al.  The Influence of Concurrent Cognitive Tasks on Postural Sway in Children , 2005, Pediatric physical therapy : the official publication of the Section on Pediatrics of the American Physical Therapy Association.

[52]  Silvia Conforto,et al.  Cognitive load affects postural control in children , 2007, Experimental Brain Research.

[53]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[54]  George E. Stelmach,et al.  Postural muscle onset and voluntary movement in the elderly , 1990, Neuroscience Letters.

[55]  M. Woollacott,et al.  Attention and the control of posture and gait: a review of an emerging area of research. , 2002, Gait & posture.

[56]  A M Wing,et al.  Age differences in postural stability are increased by additional cognitive demands. , 1996, The journals of gerontology. Series B, Psychological sciences and social sciences.

[57]  R. Chong,et al.  Specific interference between a cognitive task and sensory organization for stance balance control in healthy young adults: Visuospatial effects , 2010, Neuropsychologia.

[58]  Isabelle Olivier,et al.  Developmental changes of static standing balance in children , 2005, Neuroscience Letters.

[59]  Jukka Hyönä,et al.  Task Relevance Induces Momentary Changes in the Functional Visual Field During Reading , 2014, Psychological science.

[60]  C. Bard,et al.  Attentional demands for static and dynamic equilibrium , 2004, Experimental Brain Research.