A Review of Possible EEG Markers of Abstraction, Attentiveness, and Memorisation in Cyber-Physical Systems for Special Education

Cyber-physical systems (CPSs) for special education rely on effective mental and brain processing during the lesson, performed with the assistance of humanoid robots. The improved diagnostic ability of the CPS is a prerogative of the system for efficient technological support of the pedagogical process. The article focuses on the available knowledge of possible EEG markers of abstraction, attentiveness, and memorisation (in some cases combined with eye tracking) related to predicting effective mental and brain processing during the lesson. The role of processing abstraction is emphasised as the learning mechanism, which is given priority over the other mechanisms by the cognitive system. The main markers in focus are P1, N170, Novelty P3, RewP, N400, and P600. The description of the effects is accompanied by the analysis of some implications for the design of novel educational scenarios in inclusive classes.

[1]  Giacomo Vivanti,et al.  Attention to novelty versus repetition: Contrasting habituation profiles in Autism and Williams syndrome , 2017, Developmental Cognitive Neuroscience.

[2]  Filippo Zappasodi,et al.  Simultaneous functional near-infrared spectroscopy and electroencephalography for monitoring of human brain activity and oxygenation: a review , 2017, Neurophotonics.

[3]  Simon Finnigan,et al.  Frontal EEG delta/alpha ratio and screening for post-stroke cognitive deficits: the power of four electrodes. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  C. C. Duncan,et al.  Event-related potentials in clinical research : Guidelines for eliciting , recording , and quantifying mismatch negativity , P 300 , and N 400 , 2017 .

[5]  Michael Chapman,et al.  Meaning and the Growth of Understanding Wittgenstein's Significance for Developmental Psychology , 1989 .

[6]  W. Vanpaemel,et al.  Prototype-based category learning in autism: A review , 2021, Neuroscience & Biobehavioral Reviews.

[7]  Marta Kutas,et al.  Uncanny valley as a window into predictive processing in the social brain , 2018, Neuropsychologia.

[8]  Maya Dimitrova,et al.  Adaptive and intuitive interactions with socially-competent pedagogical assistant robots , 2015, 2015 International Conference on Information Technology Based Higher Education and Training (ITHET).

[9]  Matthew D. Lieberman,et al.  Social cognitive neuroscience: a review of core processes. , 2007, Annual review of psychology.

[10]  Samuel M. McClure,et al.  The Wick in the Candle of Learning , 2009, Psychological science.

[11]  S. Bentin,et al.  Domain specificity versus expertise: factors influencing distinct processing of faces , 2002, Cognition.

[12]  J. Nadel,et al.  Human brain spots emotion in non humanoid robots. , 2011, Social cognitive and affective neuroscience.

[13]  E. Mather.  Novelty, attention, and challenges for developmental psychology , 2013, Front. Psychol..

[14]  E. Tulving.  Episodic memory: from mind to brain. , 2002, Annual review of psychology.

[15]  Lars Strother,et al.  Atypical Asymmetry for Processing Human and Robot Faces in Autism Revealed by fNIRS , 2016, PloS one.

[16]  E. Rosch.  Wittgenstein and Categorization Research in Cognitive Psychology , 1987 .

[17]  G. Stothart,et al.  The effect of repetition priming on implicit recognition memory as measured by Fast Periodic Visual Stimulation and EEG. , 2021, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[19]  P. Rotshtein,et al.  The perceptual saliency of fearful eyes and smiles: A signal detection study , 2017, PloS one.

[20]  Matthias Schlesewsky,et al.  An alternative perspective on “semantic P600” effects in language comprehension , 2008, Brain Research Reviews.

[21]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[22]  Maya R. Gupta,et al.  How to Analyze Paired Comparison Data , 2011 .

[23]  J. Ricardo-Garcell,et al.  Auditory mismatch detection, distraction, and attentional reorientation (MMN-P3a-RON) in neurological and psychiatric disorders: A review. , 2019, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  P. Asherson,et al.  Mind wandering perspective on ADHD , 2018 .

[25]  Karl F. MacDorman,et al.  Androids as an Experimental Apparatus: Why Is There an Uncanny Valley and Can We Exploit It? , 2005 .

[26]  M. Boly,et al.  Complexity of Multi-Dimensional Spontaneous EEG Decreases during Propofol Induced General Anaesthesia , 2015, PloS one.

[27]  E. Tulving.  What kind of a hypothesis is the distinction between episodic and semantic memory , 1986 .

[28]  Jochen Triesch,et al.  Intrinsic Motivations Drive Learning of Eye Movements: An Experiment with Human Adults , 2015, PloS one.

[29]  Gyanendra Nath Tripathi,et al.  Learner Attitudes Towards Humanoid Robot Tutoring Systems , 2019, Advances in Systems Analysis, Software Engineering, and High Performance Computing.

[30]  Tony Belpaeme,et al.  People Interpret Robotic Non-linguistic Utterances Categorically , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[31]  M. Dimitrova.  Towards Design of High-Level Synthetic Sensors for Socially-Competent Computing Systems , 2016 .

[32]  Péter Simor,et al.  Novelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness , 2020, Frontiers in Human Neuroscience.

[33]  L. Thurstone.  A law of comparative judgment. , 1994 .

[34]  G. Gredebäck,et al.  Can the Brain Build Probability Distributions? , 2021, Frontiers in Psychology.

[35]  Maya Dimitrova,et al.  Designing Humanoid Robots with Novel Roles and Social Abilities , 2015 .

[36]  Maya Dimitrova,et al.  Gestalt Processing in Human-Robot Interaction: A Novel Account for Autism Research , 2015 .

[37]  M. Crocker,et al.  On the Proper Treatment of the N400 and P600 in Language Comprehension , 2017, Front. Psychol..

[38]  Maya Dimitrova,et al.  Web Agent Design Based on Computational Memory and Brain Research , 2010 .

[39]  Sarah Shultz,et al.  Inhibition of eye blinking reveals subjective perceptions of stimulus salience , 2011, Proceedings of the National Academy of Sciences.

[40]  J. Tracy,et al.  Differential brain responses when applying criterion attribute versus family resemblance rule learning , 2003, Brain and Cognition.

[41]  Narun Pornpattananangkul,et al.  Single-trial EEG dissociates motivation and conflict processes during decision-making under risk , 2019, NeuroImage.

[42]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[43]  J. Cavanagh,et al.  An EEG marker of reward processing is diminished in Parkinson’s disease , 2019, Brain Research.

[44]  Maya Dimitrova,et al.  Robotic Technology for Inclusive Education: A Cyber-Physical System Approach to Pedagogical Rehabilitation , 2020, CompSysTech.

[45]  Birte U. Forstmann,et al.  Probing the neural signature of mind wandering with simultaneous fMRI-EEG and pupillometry , 2020, NeuroImage.

[46]  Richard N. Henson,et al.  A predictive account of how novelty influences declarative memory , 2021, Neurobiology of Learning and Memory.

[47]  Richard N Henson,et al.  Predictive, interactive multiple memory systems , 2010, Hippocampus.

[48]  P. Asherson,et al.  Mind wandering perspective on attention-deficit/hyperactivity disorder , 2018, Neuroscience & Biobehavioral Reviews.

[49]  Colin M. Macleod,et al.  Word frequency effects on recall, recognition, and word fragment completion tests. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[50]  Janahan Selvanayagam,et al.  Effects of Dispositional Affect on the N400: Language Processing and Socially Situated Context , 2021, Frontiers in Psychology.

[51]  Matthias J. Gruber,et al.  How Curiosity Enhances Hippocampus-Dependent Memory: The Prediction, Appraisal, Curiosity, and Exploration (PACE) Framework , 2019, Trends in Cognitive Sciences.

[52]  Naftali Tishby,et al.  Surprise response as a probe for compressed memory states , 2020, PLoS computational biology.

[53]  R. Hunt.  The subtlety of distinctiveness: What von Restorff really did , 1995, Psychonomic bulletin & review.

[54]  M. Guitart-Masip,et al.  NOvelty-related Motivation of Anticipation and exploration by Dopamine (NOMAD): Implications for healthy aging , 2010, Neuroscience & Biobehavioral Reviews.

[55]  Robin I. M. Dunbar.  The Social Brain: Mind, Language, and Society in Evolutionary Perspective , 2003 .

[56]  Jun Ye,et al.  Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions , 2010, Comput. Educ..

[57]  M. Crocker,et al.  Event-related potentials index lexical retrieval (N400) and integration (P600) during language comprehension , 2019, Brain and Cognition.

[58]  R. Barry,et al.  Integration of three investigations of Novelty, Intensity, and Significance in dishabituation paradigms: A study of the phasic Orienting Reflex. , 2019, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[59]  D. Mumford,et al.  Neural activity in early visual cortex reflects behavioral experience and higher-order perceptual saliency , 2002, Nature Neuroscience.

[60]  Christopher M. Conway,et al.  Neurocognitive mechanisms of statistical-sequential learning: what do event-related potentials tell us? , 2014, Front. Hum. Neurosci..

[61]  Roger K. Moore.  A Bayesian explanation of the ‘Uncanny Valley’ effect and related psychological phenomena , 2012, Scientific Reports.