Action and Language Mechanisms in the Brain: Data, Models and Neuroinformatics

We assess the challenges of studying action and language mechanisms in the brain, both singly and in relation to each other to provide a novel perspective on neuroinformatics, integrating the development of databases for encoding – separately or together – neurocomputational models and empirical data that serve systems and cognitive neuroscience.

[1]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[2]  Yiannis Demiris,et al.  Information Processing in the Mirror Neuron System in Primates and Machines , 2013, Neuroinformatics.

[3]  Michael A. Arbib,et al.  Synthetic brain imaging: grasping, mirror neurons and imitation , 2000, Neural Networks.

[4]  Finn Årup Nielsen,et al.  Mass Meta-analysis in Talairach Space , 2004, NIPS.

[5]  Jessica A. Turner,et al.  Neuroinformatics Original Research Article , 2022 .

[6]  Michael A. Arbib,et al.  Language evolution: neural homologies and neuroinformatics , 2003, Neural Networks.

[7]  Alan Ruttenberg,et al.  The SWAN biomedical discourse ontology , 2008, J. Biomed. Informatics.

[8]  Richard L. Lewis,et al.  Computational principles of working memory in sentence comprehension , 2006, Trends in Cognitive Sciences.

[9]  David N. Kennedy,et al.  Making Connections in the Connectome Era , 2010, Neuroinformatics.

[10]  Daniel Bullock,et al.  Neural Representations and Mechanisms for the Performance of Simple Speech Sequences , 2010, Journal of Cognitive Neuroscience.

[11]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[12]  Ina Bornkessel-Schlesewsky,et al.  Towards a Computational Model of Actor-Based Language Comprehension , 2013, Neuroinformatics.

[13]  M. Arbib,et al.  Mirror neurons: Functions, mechanisms and models , 2013, Neuroscience Letters.

[14]  David Kennedy,et al.  Where's the beef? missing data in the information age , 2007, Neuroinformatics.

[15]  Larry W. Swanson,et al.  BAMS Neuroanatomical Ontology: Design and Implementation , 2008, Frontiers Neuroinformatics.

[16]  Gerard Kempen,et al.  The Unification Space implemented as a localist neural net: predictions and error-tolerance in a constraint-based parser , 2009, Cognitive Neurodynamics.

[17]  Jessica A. Turner,et al.  The Cognitive Paradigm Ontology: Design and Application , 2011, Neuroinformatics.

[18]  Larson Stephen,et al.  Exploring Mammalian Brain Connectivity using NeuroLex , 2014 .

[19]  Karl G. D. Bailey,et al.  Good-Enough Representations in Language Comprehension , 2002 .

[20]  Michael A. Arbib,et al.  Modeling the BOLD correlates of competitive neural dynamics , 2014, Neural Networks.

[21]  Giorgio A. Ascoli,et al.  The ups and downs of neuroscience shares , 2007, Neuroinformatics.

[22]  Ping Li,et al.  Dynamic Self-Organization and Early Lexical Development in Children , 2007, Cogn. Sci..

[23]  Masa-aki Sato,et al.  Hierarchical Bayesian estimation for MEG inverse problem , 2004, NeuroImage.

[24]  Brian MacWhinney,et al.  The logic of the unified model , 2011 .

[25]  Michael A. Arbib,et al.  Ontogenetic Ritualization of Primate Gesture as a Case Study in Dyadic Brain Modeling , 2013, Neuroinformatics.

[26]  Simon E. Fisher,et al.  Culture, Genes, and the Human Revolution , 2013, Science.

[27]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .

[28]  Karl J. Friston,et al.  PHRENOLOGY : What Can Neuroimaging Tell Us About Distributed Circuitry ? , 2005 .

[29]  David N. Kennedy.  The Benefits of Preparing Data for Sharing Even When You Don’t , 2012, Neuroinformatics.

[30]  Hans-Michael Müller,et al.  The Neuroscience Information Framework: A Data and Knowledge Environment for Neuroscience , 2008, Neuroinformatics.

[31]  Allan R. Jones,et al.  The Allen Brain Atlas: 5 years and beyond , 2009, Nature Reviews Neuroscience.

[32]  G. Orban,et al.  Comparative mapping of higher visual areas in monkeys and humans , 2004, Trends in Cognitive Sciences.

[33]  Adrian Staub,et al.  Parallelism and Competition in Syntactic Ambiguity Resolution , 2008, Lang. Linguistics Compass.

[34]  P. Hagoort.  On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[35]  Michael Arbib,et al.  Dyadic brain modelling, mirror systems and the ontogenetic ritualization of ape gesture , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[37]  L. Stein.  Creating a bioinformatics nation , 2002, Nature.

[38]  James D. Myers,et al.  Collaboratories: Doing Science on the Internet , 1996, Computer.

[39]  Michael L. Hines,et al.  NeuroML: A Language for Describing Data Driven Models of Neurons and Networks with a High Degree of Biological Detail , 2010, PLoS Comput. Biol..

[40]  E. Gibson.  Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[41]  K. J. Craik,et al.  The nature of explanation , 1944 .

[42]  G. Orban,et al.  Observing Others: Multiple Action Representation in the Frontal Lobe , 2005, Science.

[43]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[44]  M. Waldrop,et al.  Science 2.0. , 2008, Scientific American.

[45]  A. Friederici.  Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[46]  H. Damasio,et al.  Understanding otherness: the neural bases of action comprehension and pain empathy in a congenital amputee. , 2012, Cerebral cortex.

[47]  U. Bellugi,et al.  What the hands reveal about the brain , 1987 .

[48]  B. MacWhinney.  How Mental Models Encode Embodied Linguistic Perspectives , 2008 .

[49]  Wachtler Thomas.  Cloud Services and a Data API for Electrophysiology , 2012 .

[50]  David N. Kennedy,et al.  Next Steps in Data Publishing , 2011, Neuroinformatics.

[51]  Angela R Laird,et al.  Brainmap taxonomy of experimental design: Description and evaluation , 2005, Human brain mapping.

[52]  B. MacWhinney.  The CHILDES project: tools for analyzing talk , 1992 .

[53]  A. Engel,et al.  Single-trial EEG–fMRI reveals the dynamics of cognitive function , 2006, Trends in Cognitive Sciences.

[54]  Perry L. Miller,et al.  The NIF LinkOut Broker: A Web Resource to Facilitate Federated Data Integration using NCBI Identifiers , 2008, Neuroinformatics.

[55]  Risto Miikkulainen,et al.  Semantic Boost on Episodic Associations: An Empirically-Based Computational Model , 2007, Cogn. Sci..

[56]  M. Corbetta,et al.  Inter-species activity correlations reveal functional correspondences between monkey and human brain areas , 2012, Nature Methods.

[57]  M. Schlesewsky,et al.  Think globally: Cross-linguistic variation in electrophysiological activity during sentence comprehension , 2011, Brain and Language.

[58]  Hiroshi Shibasaki,et al.  Interareal connectivity in the human language system: a cortico-cortical evoked potential study , 2005 .

[59]  Stephani Foraker,et al.  Memory structures that subserve sentence comprehension , 2003 .

[60]  Michael A. Arbib,et al.  A Neuroinformatics of Brain Modeling and its Implementation in the Brain Operation Database BODB , 2013, Neuroinformatics.

[61]  M. Ullman.  Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[62]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[63]  Robert Frank,et al.  Minimal Information for Neural Electromagnetic Ontologies (MINEMO): A standards-compliant method for analysis and integration of event-related potentials (ERP) data , 2011, Standards in genomic sciences.

[64]  BMC Bioinformatics , 2005 .

[65]  Gary F. Egan,et al.  An Integrated Object Model and Method Framework for Subject-Centric e-Research Applications , 2009, Front. Neuroinform..

[66]  G. Orban,et al.  The Representation of Tool Use in Humans and Monkeys: Common and Uniquely Human Features , 2009, The Journal of Neuroscience.

[67]  Margaret Forbes,et al.  AphasiaBank: Methods for studying discourse , 2011, Aphasiology.

[68]  Michael A. Arbib,et al.  Extending the mirror neuron system model, II: what did I just do? A new role for mirror neurons , 2010, Biological Cybernetics.

[69]  G. Orban,et al.  Extracting 3D from Motion: Differences in Human and Monkey Intraparietal Cortex , 2002, Science.

[70]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[71]  Raymond J. Dolan,et al.  Computational and dynamic models in neuroimaging , 2010, NeuroImage.

[72]  Jason W. Bohland,et al.  An Informatics Approach to Integrating Genetic and Neurological Data in Speech and Language Neuroscience , 2013, Neuroinformatics.

[73]  David N. Kennedy,et al.  Neuroimaging Informatics Tools and Resources Clearinghouse (NITRC) Resource Announcement , 2009, Neuroinformatics.

[74]  Atsushi Iriki,et al.  Social cognition in premotor and parietal cortex , 2008, Social neuroscience.

[75]  A. McIntosh,et al.  Neural modeling, functional brain imaging, and cognition , 1999, Trends in Cognitive Sciences.

[76]  Gerard Kempen,et al.  An Incremental Procedural Grammar for Sentence Formulation , 1987, Cogn. Sci..

[77]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[78]  Michael A. Arbib,et al.  Synthetic event-related potentials: A computational bridge between neurolinguistic models and experiments , 2013, Neural Networks.

[79]  Roberta L. Klatzky,et al.  Embodiment, ego-space, and action , 2008 .

[80]  Masa-aki Sato,et al.  Cortical current source estimation from electroencephalography in combination with near-infrared spectroscopy as a hierarchical prior , 2012, NeuroImage.

[81]  Perry L. Miller,et al.  The NIF DISCO Framework: Facilitating Automated Integration of Neuroscience Content on the Web , 2010, Neuroinformatics.

[82]  Thomas S Deisboeck,et al.  Life Sciences and the web: a new era for collaboration , 2008, Molecular systems biology.

[83]  Constance Scharff,et al.  FOXP2 as a molecular window into speech and language. , 2009, Trends in genetics : TIG.

[84]  Anthony Randal McIntosh,et al.  Tracing the route to path analysis in neuroimaging , 2012, NeuroImage.

[85]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[86]  Eduard H. Hovy,et al.  Knowledge engineering tools for reasoning with scientific observations and interpretations: a neural connectivity use case , 2011, BMC Bioinformatics.

[87]  Finn Årup Nielsen,et al.  Brede Tools and Federating Online Neuroinformatics Databases , 2013, Neuroinformatics.

[88]  Markus Diesmann,et al.  Macaque structural connectivity revisited: CoCoMac 2.0 , 2011, BMC Neuroscience.

[89]  G. Rizzolatti,et al.  Mirrors in the Brain: How Our Minds Share Actions and Emotions , 2007 .

[90]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[91]  B. MacWhinney.  Applying the Competition Model to bilingualism , 1987, Applied Psycholinguistics.

[92]  Jinyong Lee,et al.  Template Construction Grammar: From Visual Scene Description to Language Comprehension and Agrammatism , 2013, Neuroinformatics.

[93]  Nigel H. Goddard,et al.  Towards NeuroML: model description methods for collaborative modelling in neuroscience. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[94]  Jan Derrfuss,et al.  Lost in localization: The need for a universal coordinate database , 2009, NeuroImage.

[95]  B. MacWhinney,et al.  The Handbook of East Asian Psycholinguistics: The competition model , 2006 .

[96]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[97]  P. Mitra,et al.  The Brain Atlas Concordance Problem: Quantitative Comparison of Anatomical Parcellations , 2009, PloS one.

[98]  G. Kempen,et al.  Syntactic structure assembly in human parsing: a computational model based on competitive inhibition and a lexicalist grammar , 2000, Cognition.

[99]  D. V. van Essen,et al.  The Processing of Visual Shape in the Cerebral Cortex of Human and Nonhuman Primates: A Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[100]  Yasuo Nagasaka,et al.  Encoding of social state information by neuronal activities in the macaque caudate nucleus , 2012, Social neuroscience.

[101]  Michael Arbib,et al.  Extending the mirror neuron system model, I. Audible actions and invisible grasps. , 2007, Biological cybernetics.

[102]  Simon E Fisher,et al.  Genetic susceptibility to stuttering. , 2010, The New England journal of medicine.

[103]  Gerard Kempen,et al.  Prolegomena to a Neurocomputational Architecture for Human Grammatical Encoding and Decoding , 2013, Neuroinformatics.

[104]  Matthias Schlesewsky,et al.  The extended argument dependency model: a neurocognitive approach to sentence comprehension across languages. , 2006, Psychological review.

[105]  J. Hawkins.  PROCESSING COMPLEXITY AND FILLER-GAP DEPENDENCIES ACROSS GRAMMARS , 1999 .

[106]  Michael A. Arbib,et al.  Précis of How the brain got language: The Mirror System Hypothesis , 2012, Language and Cognition.

[107]  Ina Bornkessel-Schlesewsky,et al.  The Role of Prominence Information in the Real-Time Comprehension of Transitive Constructions: A Cross-Linguistic Approach , 2009, Lang. Linguistics Compass.

[108]  William C. Ritchie,et al.  Handbook of Second Language Acquisition , 1998 .

[109]  Danilo Bzdok,et al.  The BrainMap strategy for standardization, sharing, and meta-analysis of neuroimaging data , 2011, BMC Research Notes.

[110]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[111]  C. Fillmore.  FRAME SEMANTICS AND THE NATURE OF LANGUAGE * , 1976 .

[112]  Angela R. Laird,et al.  BrainMap , 2007, Neuroinformatics.

[113]  Michael J Cortese,et al.  Handbook of Psycholinguistics , 2011 .

[114]  Rolf Kötter,et al.  Online retrieval, processing, and visualization of primate connectivity data from the CoCoMac Database , 2007, Neuroinformatics.

[115]  Gregory Hickok,et al.  The functional neuroanatomy of language. , 2009, Physics of life reviews.

[116]  Michael A. Arbib,et al.  Integrating databases and expert systems for the analysis of brain structures , 2007, Neuroinformatics.