Parallels between Machine and Brain Decoding

We report some existing work, inspired by analogies between human thought and machine computation, showing that the informational state of a digital computer can be decoded in a similar way to brain decoding. We then discuss some proposed work that would leverage this analogy to shed light on the amount of information that may be missed by the technical limitations of current neuroimaging technologies.

[1]  van Gerardus Noord,et al.  Proceedings of the 23rd International Conference on Computational Linguistics (COLING 2010) , 2010 .

[2]  Noam Chomsky.  Review of B.F. Skinner, Verbal Behavior , 1959 .

[3]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[4]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[5]  D. Buxhoeveden,et al.  The minicolumn hypothesis in neuroscience. , 2002, Brain : a journal of neurology.

[6]  Geoffrey E. Hinton,et al.  Distributed representations and nested compositional structure , 1994 .

[7]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[8]  Jeffrey M. Bradshaw,et al.  Brain Informatics , 2011 .

[9]  Sydney S. Cash,et al.  Decoding word and category-specific spatiotemporal representations from MEG and EEG , 2011, NeuroImage.

[10]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[11]  Patrick Pantel,et al.  DIRT @SBT@discovery of inference rules from text , 2001, KDD '01.

[12]  Alex S. Taylor,et al.  Machine intelligence , 2009, CHI.

[13]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[14]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[15]  Michael N Jones,et al.  Representing word meaning and order information in a composite holographic lexicon. , 2007, Psychological review.

[16]  Riitta Salmelin,et al.  Tracking neural coding of perceptual and semantic features of concrete nouns , 2012, NeuroImage.

[17]  Danilo Croce,et al.  Comparing EEG/ERP-Like and fMRI-Like Techniques for Reading Machine Thoughts , 2010, Brain Informatics.

[18]  R. Montague.  Formal philosophy; selected papers of Richard Montague , 1974 .

[19]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[20]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[21]  John von Neumann,et al.  First draft of a report on the EDVAC , 1993, IEEE Annals of the History of Computing.

[22]  Richard Montague,et al.  ENGLISH AS A FORMAL LANGUAGE , 1975 .

[23]  Roberto Basili,et al.  Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics , 2009 .

[24]  Norbert Wiener,et al.  Cybernetics, Second Edition: or the Control and Communication in the Animal and the Machine , 1965 .

[25]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[26]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[27]  E. Guevara.  A Regression Model of Adjective-Noun Compositionality in Distributional Semantics , 2010 .

[28]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[29]  Danilo Croce,et al.  Reading What Machines "Think" , 2009, Brain Informatics.

[30]  B. Turetsky,et al.  Sex Differences in Brain Gray and White Matter in Healthy Young Adults: Correlations with Cognitive Performance , 1999, The Journal of Neuroscience.

[31]  Mirella Lapata,et al.  Dependency-Based Construction of Semantic Space Models , 2007, CL.

[32]  Marco Baroni,et al.  Nouns are Vectors, Adjectives are Matrices: Representing Adjective-Noun Constructions in Semantic Space , 2010, EMNLP.

[33]  Ioannis Korkontzelos,et al.  Estimating Linear Models for Compositional Distributional Semantics , 2010, COLING.

[34]  Gerhardt von Bonin,et al.  Cybernetics or control and communication in the animal and the machine: Norbert wiener, 1948. 194 pp. New York: John Wiley & Sons, Inc. Paris: Hermann et cie , 1949 .

[35]  L. Bruzzone,et al.  EEG decoding of semantic category reveals distributed representations for single concepts , 2011, Brain and Language.

[36]  K. Salzinger.  Skinner's Verbal Behavior , 2008 .

[37]  Mirella Lapata,et al.  Vector-based Models of Semantic Composition , 2008, ACL.

[38]  Pablo Alvarado,et al.  A XON 2 — A visual object recognitionsystemfor non-rigid objects , 2001 .

[39]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[40]  G. Miller,et al.  Contextual correlates of semantic similarity , 1991 .

[41]  K. M. Liew,et al.  Fracture Properties of Defective Carbon Nanorings , 2011 .

[42]  Noam Chomsky,et al.  A Review of B. F. Skinner's Verbal Behavior , 1980 .

[43]  A. Ishai,et al.  Distinct, overlapping representations of faces and multiple categories of objects in ventral temporal cortex , 2001, NeuroImage.

[44]  Massimo Poesio,et al.  EEG responds to conceptual stimuli and corpus semantics , 2009, EMNLP.

[45]  S. Pinker.  How the Mind Works , 1999, Philosophy after Darwin.

[46]  Ping Li,et al.  The Acquisition of Word Meaning through Global Lexical Co-occurrences , 2000 .

[47]  Jack Kaminsky,et al.  Dimensions of Mind. , 1961 .

[48]  Diana McCarthy,et al.  Disambiguating Nouns, Verbs, and Adjectives Using Automatically Acquired Selectional Preferences , 2003, CL.

[49]  Danilo Croce,et al.  Reading What Machines "Think": A Challenge for Nanotechnology , 2011 .

[50]  Faith M. Gunning-Dixon,et al.  Aging, sexual dimorphism, and hemispheric asymmetry of the cerebral cortex: replicability of regional differences in volume , 2004, Neurobiology of Aging.

[51]  Osamu Abe,et al.  Reduced Gray Matter Volume of Pars Opercularis Is Associated with Impaired Social Communication in High-Functioning Autism Spectrum Disorders , 2010, Biological Psychiatry.

[52]  P. Hagoort.  On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[53]  B. Pakkenberg,et al.  The effect of age and gender on the volume and size distribution of neocortical neurons , 2007, Neuroscience.

[54]  Gerard Casey.  Minds and machines , 1992 .

[55]  Dekang Lin,et al.  DIRT – Discovery of Inference Rules from Text , 2001 .

[56]  Frederico A. C. Azevedo,et al.  Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled‐up primate brain , 2009, The Journal of comparative neurology.

[57]  J. Katz,et al.  The philosophy of linguistics , 1989 .

[58]  J. Firth.  Papers in linguistics , 1958 .

[59]  B. Pakkenberg,et al.  Neocortical neuron number in humans: Effect of sex and age , 1997, The Journal of comparative neurology.

[60]  Zellig S. Harris,et al.  Distributional Structure , 1954 .