Process algebraic modelling of attentional capture and human electrophysiology in interactive systems

Previous research has developed a formal methods-based (cognitive-level) model of the Interacting Cognitive Subsystems central engine, with which we have simulated attentional capture in the context of Barnard’s key-distractor Attentional Blink task. This model captures core aspects of the allocation of human attention over time and as such should be applicable across a range of practical settings when human attentional limitations come into play. In addition, this model simulates human electrophysiological data, such as electroencephalogram recordings, which can be compared to real electrophysiological data recorded from human participants. We have used this model to evaluate the performance trade-offs that would arise from varying key parameters and applying either a constructive or a reactive approach to improving interactive systems in a stimulus rich environment. A strength of formal methods is that they are abstract and the resulting specifications of the operator are general purpose, ensuring that our findings are broadly applicable. Thus, we argue that new modelling techniques from computer science can also be employed in computational modelling of the mind. These would complement existing techniques, being specifically targeted at psychological level modelling, in which it is advantageous to directly represent the distribution of control.

[1]  C. Carver,et al.  On the Self-Regulation of Behavior , 1998 .

[2]  Philip J. Barnard,et al.  Attentional Capture by Meaning, a Multi-level Modeling Study , 2007 .

[3]  Christos Faloutsos,et al.  Data mining meets performance evaluation: fast algorithms for modeling bursty traffic , 2002, Proceedings 18th International Conference on Data Engineering.

[4]  Howard Bowman,et al.  Computational and Experimental Evaluation of the Attentional Blink: Testing the Simultaneous Type Serial Token Model , 2005 .

[5]  Helge J. Ritter,et al.  Improving Transfer Rates in Brain Computer Interfacing: A Case Study , 2002, NIPS.

[6]  Howard Bowman,et al.  Electrophysiological Feedback in Adaptive Human Computer Interfaces , 2022 .

[7]  Francesco Piccione,et al.  User adaptive BCIs: SSVEP and P300 based interfaces , 2003, PsychNology J..

[8]  David A. Duce,et al.  Syndetic Modelling , 1998, Hum. Comput. Interact..

[9]  C. Carver,et al.  On the Self-Regulation of Behavior: Goal Engagement, Life, and Death , 1998 .

[10]  Howard Bowman,et al.  Concurrency Theory: Calculi an Automata for Modelling Untimed and Timed Concurrent Systems , 2005 .

[11]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[12]  E T Rolls,et al.  A model of the interaction between mood and memory , 2001, Network.

[13]  H. Leventhal,et al.  A Perceptual-Motor Processing Model of Emotion , 1979 .

[14]  J. F. Mackworth The duration of the visual image. , 1963 .

[15]  A H Bond Describing behavioral states using a system model of the primate brain , 1999, American journal of primatology.

[16]  De Vries Book review: R.C. O'Reilly and Y. Munakata: Computational explorations in cognitive neuroscience: understanding the mind by stimulating the brain. Cambridge, Mass: The MIT Press. , 2002 .

[17]  P. Barnard,et al.  Paying Attention to Meaning , 2004, Psychological science.

[18]  Shane T. Mueller,et al.  Models of Working Memory: Insights into Working Memory from the Perspective of the EPIC Architecture for Modeling Skilled Perceptual-Motor and Cognitive Human Performance , 1998 .

[19]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[20]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[21]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[22]  Hartmut Ehrig,et al.  ACT ONE - An Algebraic Specification Language with two Levels of Semantics , 1983, ADT.

[23]  Richard P. Cooper,et al.  A Systematic Methodology for Cognitive Modelling , 1996, Artif. Intell..

[24]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[25]  César Viho,et al.  System design of a CC-NUMA multiprocessor architecture using formal specification, model-checking, co-simulation, and test generation , 2001, International Journal on Software Tools for Technology Transfer.

[26]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[27]  M. Mattson,et al.  From words to meaning: A semantic illusion , 1981 .

[28]  Tommaso Bolognesi,et al.  Tableau methods to describe strong bisimilarity on LOTOS processes involving pure interleaving and enabling , 1994, FORTE.

[29]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[30]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[31]  Philip J. Barnard,et al.  Affect, Cognition and Change: Re-Modelling Depressive Thought , 1993 .

[32]  M. Raijmakers Rethinking innateness: A connectionist perspective on development. , 1997 .

[33]  Howard Bowman,et al.  The Attentional Blink Reveals Serial Working Memory Encoding: Evidence from Virtual and Human Event-related Potentials , 2009, Journal of Cognitive Neuroscience.

[34]  A. Newell Unified Theories of Cognition , 1990 .

[35]  William L. Wilkie,et al.  Presidential Address: 1980 , 1981 .

[36]  M.E. Gomez,et al.  Self-similarity in I/O workload: analysis and modeling , 1998, Workload Characterization: Methodology and Case Studies. Based on the First Workshop on Workload Characterization.

[37]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[38]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[39]  E. Vogel,et al.  Electrophysiological Evidence for a Postperceptual Locus of Suppression during the Attentional Blink Time-based Attention and the Attentional Blink , 1998 .

[40]  Howard Bowman,et al.  Analysis of a Multimedia Stream using Stochastic Process Algebra , 2001, Comput. J..

[41]  Radu Mateescu,et al.  An overview of CADP 2001 , 2001 .

[42]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[43]  Jos C. M. Baeten,et al.  Process Algebra with Timing , 2002, Monographs in Theoretical Computer Science. An EATCS Series.

[44]  Philip J. Barnard,et al.  Models of Working Memory: Interacting Cognitive Subsystems: Modeling Working Memory Phenomena Within a Multiprocessor Architecture , 1999 .

[45]  K. Shapiro,et al.  Personal names and the attentional blink: a visual "cocktail party" effect. , 1997, Journal of experimental psychology. Human perception and performance.

[46]  N. Kanwisher,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Recognition As Soon as You Know It Is There, You Know What It Is , 2022 .

[47]  S P Levine,et al.  A direct brain interface based on event-related potentials. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[48]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[49]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[50]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[51]  Li Su,et al.  Attentional Capture by Meaning , a Multi-level Modelling Study , 2022 .

[52]  A. Anderson Affective influences on the attentional dynamics supporting awareness. , 2005, Journal of experimental psychology. General.

[53]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[54]  Li Su,et al.  Performance of Reactive Interfaces in Stimulus Rich Environments, Applying Formal Methods and Cognitive Frameworks , 2008, FMIS@BCS HCI.

[55]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[56]  Howard Bowman,et al.  Rendering information processing models of cognition and affect compu- tationally explicit: distributed executive control and the deployment of attention , 2003 .

[57]  P.J. Cilliers,et al.  A VEP-based computer interface for C2-ouadriplegics , 1993, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ.

[58]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[59]  Philip J. Barnard,et al.  Anxiety and the deployment of visual attention over time , 2005 .

[60]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[61]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[62]  W. Maki,et al.  Associative priming by targets and distractors during rapid serial visual presentation: does word meaning survive the attentional blink? , 1997, Journal of experimental psychology. Human perception and performance.

[63]  B. Wyble,et al.  The simultaneous type, serial token model of temporal attention and working memory. , 2007, Psychological review.

[64]  Howard Bowman,et al.  Analysing Cognitive Behaviour using LOTOS and Mexitl , 1999, Formal Aspects of Computing.