Investigating Semantic Relationship between the Scene and the Sound within the Scene by Dynamic Causal Modeling

The purpose of the paper was to explore the dynamic information flow among brain regions, which took part in the perception of the semantic relationship between the scene and the sound of the object within the scene. 15 healthy volunteers were recruited to observe the 4 categories (32 subclasses) of the scene pictures and listened to the 8 categories (64 kinds) of sound corresponding to each scene, and the data were collected and analyzed by functional magnetic resonance imaging. Dynamic causal modeling method embedded in spm8 to analyze the connection among brain regions involved in different experimental tasks. Six candidate models were constructed, and an optimal model was determined by Bayesian model selection. In the optimal model, the flow of information between the parahippocampal place area (PPA) and the lateral occipital complex (LO) under the adjustment of the scene condition was interactive, and the sound condition influenced the activity of the STS. The results showed that the existence of the information flow among the brain regions were selective to the object sound or the scene, which was essential for the processing of the semantic relationship between the human brain's perceived sound and the scene. Keywords-functional magnetic resonance imaging; dynamic causal modeling; semantic relationship; scene recognition

[1]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[2]  John S. Duncan,et al.  Noninvasive in vivo demonstration of the connections of the human parahippocampal gyrus , 2004, NeuroImage.

[3]  Leslie G. Ungerleider,et al.  Distributed representation of objects in the human ventral visual pathway. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Russell A. Epstein,et al.  Constructing scenes from objects in human occipitotemporal cortex , 2011, Nature Neuroscience.

[5]  Dwight J. Kravitz,et al.  The ventral visual pathway: an expanded neural framework for the processing of object quality , 2013, Trends in Cognitive Sciences.

[6]  M. Catani,et al.  A diffusion tensor imaging tractography atlas for virtual in vivo dissections , 2008, Cortex.

[7]  Russell A. Epstein,et al.  Differential parahippocampal and retrosplenial involvement in three types of visual scene recognition. , 2006, Cerebral cortex.

[8]  J. Bolz,et al.  Functional specificity of a long-range horizontal connection in cat visual cortex: a cross-correlation study , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Karl J. Friston.  Functional and effective connectivity in neuroimaging: A synthesis , 1994 .

[10]  Derek K. Jones,et al.  Occipito-temporal connections in the human brain. , 2003, Brain : a journal of neurology.

[11]  D. Margulies,et al.  Development of anterior cingulate functional connectivity from late childhood to early adulthood. , 2009, Cerebral cortex.

[12]  Christoph M. Michel,et al.  The Neural Substrates and Timing of Top–Down Processes during Coarse-to-Fine Categorization of Visual Scenes: A Combined fMRI and ERP Study , 2010, Journal of Cognitive Neuroscience.

[13]  Karl J. Friston,et al.  Ten simple rules for dynamic causal modeling , 2010, NeuroImage.

[14]  Monica Baciu,et al.  Cerebral regions and hemispheric specialization for processing spatial frequencies during natural scene recognition. An event-related fMRI study , 2004, NeuroImage.