Semantic Modulation of Temporal Attention: Distributed Control and Levels of Abstraction in Computational Modelling

This paper presents a computational exploration of how meaning modulates temporal attention. This has been explored within the context of Barnard et al's key-distractor Attentional Blink (AB) and proposes a mechanism by which attention is captured by salient meaning. We also explore the applicability of formal methods to the abstract modelling of cognition. Such formal methods enable modelling of an important class of cognitive architectures in which multiple subsystems interact and control is distributed. Most significantly, we have used the formal methods framework to explore the problem of how to relate different levels of abstraction / description in cognitive modelling. Our modelling of Barnard's ICS (Interacting Cognitive Subsystems) architecture illustrates this approach. A major result of our work is the simulation of the key-distractor AB. This simulation is formulated in terms of the interaction between ICS' two central subsystems, which extract implicational and propositional meaning, respectively. Items related to a target category may be interpreted as implicationally salient, even though a later propositional check reveals they are not targets. Such items capture attention, creating a window of time in which the system is vulnerable to missing actual targets. We also explore how changes in semantic salience modulate the key-distractor AB, thereby clarifying the temporal properties of attentional capture by semantic salience.

[1]  A H Bond Describing behavioral states using a system model of the primate brain , 1999, American journal of primatology.

[2]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[3]  Krysia Broda,et al.  Neural-symbolic learning systems - foundations and applications , 2012, Perspectives in neural computing.

[4]  E T Rolls,et al.  A model of the interaction between mood and memory , 2001, Network.

[5]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[6]  Andrew William Roscoe,et al.  The Theory and Practice of Concurrency , 1997 .

[7]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[8]  Jim Woodcock,et al.  Using Z - specification, refinement, and proof , 1996, Prentice Hall international series in computer science.

[9]  Philip J. Barnard,et al.  Anxiety and the deployment of visual attention over time , 2005 .

[10]  M. Mattson,et al.  From words to meaning: A semantic illusion , 1981 .

[11]  V. Coltheart Fleeting memories : cognition of brief visual stimuli , 1999 .

[12]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[13]  Masanori Hashimoto,et al.  Crosstalk noise estimation for generic RC trees , 2001, Proceedings 2001 IEEE International Conference on Computer Design: VLSI in Computers and Processors. ICCD 2001.

[14]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[15]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[16]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[17]  B. Wyble,et al.  Formal Modeling of Connectionism using Concurrency Theory , an Approach Based on Automata and Model Checking * , 2006 .

[18]  Howard Bowman,et al.  Analysing Cognitive Behaviour using LOTOS and Mexitl , 1999, Formal Aspects of Computing.

[19]  Krysia Broda,et al.  Neural-Symbolic Learning Systems , 2002 .

[20]  Perdita Stevens,et al.  Refinement in Z and object-Z: foundations and advanced applications , 2002, Softw. Test. Verification Reliab..

[21]  Cristina V. Lopes,et al.  Aspect-oriented programming , 1999, ECOOP Workshops.

[22]  Philip J. Barnard,et al.  Models of Working Memory: Interacting Cognitive Subsystems: Modeling Working Memory Phenomena Within a Multiprocessor Architecture , 1999 .

[23]  Howard Bowman,et al.  Rendering information processing models of cognition and affect compu- tationally explicit: distributed executive control and the deployment of attention , 2003 .

[24]  Wc Taylor,et al.  Special Issue , 2000, International Journal of Recent Technology and Engineering.

[25]  K. Shapiro,et al.  Personal names and the attentional blink: a visual "cocktail party" effect. , 1997, Journal of experimental psychology. Human perception and performance.

[26]  K. McDermott,et al.  Creating false memories: Remembering words not presented in lists. , 1995 .

[27]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[28]  Edmund T. Rolls,et al.  Introduction to Connectionist Modelling of Cognitive Processes , 1998 .

[29]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[30]  Fred B. Schneider,et al.  A Logical Approach to Discrete Math , 1993, Texts and Monographs in Computer Science.

[31]  Massoud Pedram,et al.  Capacitive coupling noise in high-speed VLSI circuits , 2005, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[32]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[33]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[34]  Zohar Manna,et al.  The Temporal Logic of Reactive and Concurrent Systems , 1991, Springer New York.

[35]  강문설 [서평]「The Unified Modeling Language User Guide」 , 1999 .

[36]  Philip J. Barnard,et al.  Affect, Cognition and Change: Re-Modelling Depressive Thought , 1993 .

[37]  B. Wyble,et al.  The simultaneous type, serial token model of temporal attention and working memory. , 2007, Psychological review.

[38]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[39]  Howard Bowman,et al.  Computational Modelling of Distributed Executive Control , 2001 .

[40]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[41]  Howard Bowman,et al.  Concurrency Theory: Calculi an Automata for Modelling Untimed and Timed Concurrent Systems , 2005 .

[42]  A. Anderson Affective influences on the attentional dynamics supporting awareness. , 2005, Journal of experimental psychology. General.

[43]  Howard Bowman,et al.  A Formal Framework for Viewpoint Consistency , 2002, Formal Methods Syst. Des..

[44]  P. Barnard,et al.  Paying Attention to Meaning , 2004, Psychological science.

[45]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[46]  Ivar Jacobson,et al.  The Unified Modeling Language User Guide , 1998, J. Database Manag..

[47]  Gregor Kiczales,et al.  Aspect-oriented programming , 2001, ESEC/FSE-9.

[48]  S Dehaene,et al.  A neuronal model of a global workspace in effortful cognitive tasks. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[49]  W. Maki,et al.  Associative priming by targets and distractors during rapid serial visual presentation: does word meaning survive the attentional blink? , 1997, Journal of experimental psychology. Human perception and performance.

[50]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[51]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[52]  Zenon W. Pylyshyn,et al.  Connectionism and cognitive architecture , 1993 .

[53]  Gordon D. A. Brown,et al.  Absolute identification by relative judgment. , 2005, Psychological review.

[54]  Erich Novak,et al.  Special issue , 2006, J. Complex..

[55]  Howard Bowman,et al.  Symbolic Encoding of Neural Networks using Communicating Automata with Applications to Verification of Neural Network Based Controllers , 2005 .

[56]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[57]  Refractor Vision , 2000, The Lancet.