Shannon Versus Chomsky: Brain Potentials and the Syntax-Semantics Distinction

The N400 and the P600 are two patterns of electrical brain potentials which can sometimes be found when people read or hear unexpected words. They have been widely claimed to be the neurological correlates of semantic and syntactic anomalies, respectively, but evidence accumulated over the last decade has raised some serious doubts about that interpretation. In this paper, I first review some of this evidence and then present an alternative way to think about the issue. My suggestion is built on Shannon’s concept of noisy-channel decoding by tables of typical sets, and it is thus fundamentally statistical in nature. I show that a proper application of Shannon’s concepts to the reading process provides an interesting reinterpretation of our notion of “syntax,” thus questioning some fundamental assumptions of linguistics.

[1]  D. Caplan,et al.  Electrophysiological distinctions in processing conceptual relationships within simple sentences. , 2003, Brain research. Cognitive brain research.

[2]  H. Kolk,et al.  An ERP study of P600 effects elicited by semantic anomalies. , 2005, Brain research. Cognitive brain research.

[3]  Anja Hahne,et al.  Event-Related Brain Potentials While Encountering Semantic and Syntactic Constraint Violations , 1993, Journal of Cognitive Neuroscience.

[4]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[5]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[6]  Mante S. Nieuwland,et al.  Testing the limits of the semantic illusion phenomenon: ERPs reveal temporary semantic change deafness in discourse comprehension. , 2005, Brain research. Cognitive brain research.

[7]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[8]  E. S. Pearson,et al.  ON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE PART I , 1928 .

[9]  Eva M. Fernández,et al.  Fundamentals of Psycholinguistics , 2010 .

[10]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[11]  L. Osterhout,et al.  The independence of combinatory semantic processing: Evidence from event-related potentials , 2005 .

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  Thomas M. Cover,et al.  An achievable rate region for the broadcast channel , 1975, IEEE Trans. Inf. Theory.

[14]  Fred J. Damerau,et al.  A technique for computer detection and correction of spelling errors , 1964, CACM.

[15]  John C J Hoeks,et al.  Seeing words in context: the interaction of lexical and sentence level information during reading. , 2004, Brain research. Cognitive brain research.

[16]  R Bellman,et al.  On the Theory of Dynamic Programming. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[17]  John R. Anderson,et al.  The place of cognitive architectures in a rational analysis , 1988 .

[18]  Dorothee J. Chwilla,et al.  When Heuristics Clash with Parsing Routines: ERP Evidence for Conflict Monitoring in Sentence Perception , 2006, Journal of Cognitive Neuroscience.

[19]  Lee Osterhout,et al.  Event-related potentials and syntactic anomaly: Evidence of anomaly detection during the perception of continuous speech , 1993 .

[20]  Matthias Schlesewsky,et al.  An alternative perspective on “semantic P600” effects in language comprehension , 2008, Brain Research Reviews.

[21]  M. Kutas,et al.  An electrophysiological analysis of animacy effects in the processing of object relative sentences. , 1999, Psychophysiology.

[22]  Leon Bergen,et al.  Rational integration of noisy evidence and prior semantic expectations in sentence interpretation , 2013, Proceedings of the National Academy of Sciences.

[23]  Ina Bornkessel-Schlesewsky,et al.  Conflicts in language processing: A new perspective on the N400–P600 distinction , 2011, Neuropsychologia.

[24]  Gina R. Kuperberg,et al.  Neural mechanisms of language comprehension: Challenges to syntax , 2007, Brain Research.

[25]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[26]  H. Kolk,et al.  Structure and limited capacity in verbal working memory: A study with event-related potentials , 2003, Brain and Language.

[27]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[28]  Kevin Knight,et al.  Decoding Complexity in Word-Replacement Translation Models , 1999, Comput. Linguistics.