Neural similarity at temporal lobe and cerebellum predicts out-of-sample preference and recall for video stimuli

The extent to which brains respond similarly to a specific stimulus, across a small group of individuals, has been previously found to predict out-of-sample aggregate preference for that stimulus. However, the location in the brain where neural similarity predicts out-of-sample preference remains unclear. In this article, we attempt to identify the neural substrates in three functional magnetic resonance imaging (fMRI) studies. Two fMRI studies (N = 40 and 20), using previously broadcasted TV commercials, show that spatiotemporal neural similarity at temporal lobe and cerebellum predict out-of-sample preference and recall. A follow-up fMRI study (N = 28) with previously unseen movie-trailers replicated the predictive effect of neural similarity. Moreover, neural similarity provided unique information on out-of-sample preference above and beyond in-sample preference. Overall, the findings suggest that neural similarity at temporal lobe and cerebellum - traditionally associated with sensory integration and emotional processing - may reflect the level of engagement with video stimuli.

[1]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[2]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[3]  D. Norris,et al.  BOLD contrast sensitivity enhancement and artifact reduction with multiecho EPI: Parallel‐acquired inhomogeneity‐desensitized fMRI , 2006, Magnetic resonance in medicine.

[4]  B. Argall,et al.  Unraveling multisensory integration: patchy organization within human STS multisensory cortex , 2004, Nature Neuroscience.

[5]  Emily S. Cross,et al.  The Impact of Aesthetic Evaluation and Physical Ability on Dance Perception , 2011, Front. Hum. Neurosci..

[6]  Cara L. Wong,et al.  The function of the anterior temporal lobe: A review of the empirical evidence , 2012, Brain Research.

[7]  I. Olson,et al.  The Enigmatic temporal pole: a review of findings on social and emotional processing. , 2007, Brain : a journal of neurology.

[8]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[9]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[10]  Kosha Ruparel,et al.  Reduced prefrontal and temporal processing and recall of high “sensation value” ads , 2009, NeuroImage.

[11]  Alexander Genevsky,et al.  Neuroforecasting Aggregate Choice , 2018, Current directions in psychological science.

[12]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[13]  L. Davachi,et al.  Enhanced Intersubject Correlations during Movie Viewing Correlate with Successful Episodic Encoding , 2008, Neuron.

[14]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[15]  Moran Cerf,et al.  A Ticket for Your Thoughts: Method for Predicting Content Recall and Sales Using Neural Similarity of Moviegoers , 2017 .

[16]  Jason J. Ki,et al.  Attention Strongly Modulates Reliability of Neural Responses to Naturalistic Narrative Stimuli , 2016, The Journal of Neuroscience.

[17]  René Weber,et al.  Neural contributions to flow experience during video game playing. , 2012, Social cognitive and affective neuroscience.

[18]  In Kyoon Lyoo,et al.  Brain activity and desire for Internet video game play. , 2011, Comprehensive psychiatry.

[19]  Pia Tikka,et al.  Consistency and similarity of MEG- and fMRI-signal time courses during movie viewing , 2018, NeuroImage.

[20]  Gregory R. Samanez-Larkin,et al.  Decision making in the ageing brain: changes in affective and motivational circuits , 2015, Nature Reviews Neuroscience.

[21]  Maarten A. S. Boksem,et al.  Neural Responses to Functional and Experiential Ad Appeals: Explaining Ad Effectiveness , 2017 .

[22]  Iiro P. Jääskeläinen,et al.  Brain hemodynamic activity during viewing and re-viewing of comedy movies explained by experienced humor , 2016, Scientific Reports.

[23]  Uri Hasson,et al.  Engaged listeners: shared neural processing of powerful political speeches. , 2015, Social cognitive and affective neuroscience.

[24]  John S. Johnson,et al.  Audience preferences are predicted by temporal reliability of neural processing , 2014, Nature Communications.

[25]  Stefan Pollmann,et al.  Neuroinformatics Original Research Article Pymvpa: a Unifying Approach to the Analysis of Neuroscientifi C Data , 2022 .

[26]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[27]  Mikko Sams,et al.  Neural mechanisms for integrating consecutive and interleaved natural events , 2017, Human brain mapping.

[28]  Jeffrey M. Zacks,et al.  Searchlight analysis: Promise, pitfalls, and potential , 2013, NeuroImage.

[29]  Hyun Suk Kim,et al.  A neural model of valuation and information virality , 2017, Proceedings of the National Academy of Sciences.

[30]  Hans-Jochen Heinze,et al.  Coding of multisensory temporal patterns in human superior temporal sulcus , 2012, Front. Integr. Neurosci..

[31]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[32]  S. Huettel,et al.  A nexus model of the temporal–parietal junction , 2013, Trends in Cognitive Sciences.

[33]  R. Hari,et al.  Emotions promote social interaction by synchronizing brain activity across individuals , 2012, Proceedings of the National Academy of Sciences.

[34]  Ale Smidts,et al.  Brain Responses to Movie Trailers Predict Individual Preferences for Movies and Their Population-Wide Commercial Success , 2015 .

[35]  D. Poeppel,et al.  Coupled neural systems underlie the production and comprehension of naturalistic narrative speech , 2014, Proceedings of the National Academy of Sciences.

[36]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[37]  Mikko Sams,et al.  Emotional speech synchronizes brains across listeners and engages large-scale dynamic brain networks , 2014, NeuroImage.

[38]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[39]  U. Hasson,et al.  On the Same Wavelength: Predictable Language Enhances Speaker–Listener Brain-to-Brain Synchrony in Posterior Superior Temporal Gyrus , 2014, The Journal of Neuroscience.

[40]  Salvador Soto-Faraco,et al.  Top-down attention regulates the neural expression of audiovisual integration , 2015, NeuroImage.

[41]  秋元 実治 The Function of 'To Be' , 1971 .

[42]  Maria Theodorou,et al.  Your Brain on the Movies: A Computational Approach for Predicting Box-office Performance from Viewer’s Brain Responses to Movie Trailers , 2017, Front. Neuroinform..

[43]  G. Berns,et al.  A Neural Predictor of Cultural Popularity , 2010 .

[44]  Michael Eickenberg,et al.  Machine learning for neuroimaging with scikit-learn , 2014, Front. Neuroinform..

[45]  A. Rangel,et al.  Dissociating valuation and saliency signals during decision-making. , 2011, Cerebral cortex.

[46]  Talma Hendler,et al.  Neural dynamics underlying emotional transmissions between individuals , 2017, Social cognitive and affective neuroscience.

[47]  Carolyn Yoon,et al.  When Brain Beats Behavior: Neuroforecasting Crowdfunding Outcomes , 2017, The Journal of Neuroscience.

[48]  Emily B. Falk,et al.  From Neural Responses to Population Behavior , 2012, Psychological science.

[49]  D. Caplan,et al.  Cognition, emotion and the cerebellum. , 2006, Brain : a journal of neurology.

[50]  Reginald B. Adams,et al.  The reward of a good joke: neural correlates of viewing dynamic displays of stand-up comedy , 2011, Cognitive, affective & behavioral neuroscience.

[51]  Riitta Hari,et al.  Intersubject consistency of cortical MEG signals during movie viewing , 2014, NeuroImage.

[52]  K. Mathiak,et al.  Toward brain correlates of natural behavior: fMRI during violent video games , 2006, Human brain mapping.

[53]  William H. Hampton,et al.  Predicting Advertising success beyond Traditional Measures: New Insights from Neurophysiological Methods and Market Response Modeling , 2015 .