Understanding Relevance: An fMRI Study

Relevance is one of the key concepts in Information Retrieval (IR). A huge body of research exists that attempts to understand this concept so as to operationalize it for IR systems. Despite advances in the past few decades, answering the question "How does relevance happen?" is still a big challenge. In this paper, we investigate the connection between relevance and brain activity. Using functional Magnetic Resonance Imaging (fMRI), we measured the brain activity of eighteen participants while they performed four topical relevance assessment tasks on relevant and non-relevant images. The results of this experiment revealed three brain regions in the frontal, parietal and temporal cortex where brain activity differed between processing relevant and non-relevant documents. This is an important step in unravelling the nature of relevance and therefore better utilising it for effective retrieval.

[1]  Nicholas J. Belkin,et al.  Display time as implicit feedback: understanding task effects , 2004, SIGIR '04.

[2]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[3]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[4]  David M. Nichols,et al.  Implicit Rating and Filtering , 1998 .

[5]  V. Mildner The cognitive neuroscience of human communication , 2007 .

[6]  Joemon M. Jose,et al.  A comparison of general vs personalised affective models for the prediction of topical relevance , 2010, SIGIR '10.

[7]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[8]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[9]  Nicholas J. Belkin,et al.  A case for interaction: a study of interactive information retrieval behavior and effectiveness , 1996, CHI.

[10]  Peter A. Bandettini,et al.  Twenty years of functional MRI: The science and the stories , 2012, NeuroImage.

[11]  D. Heeger,et al.  In this issue , 2002, Nature Reviews Drug Discovery.

[12]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[13]  Joemon M. Jose,et al.  Enriching user profiling with affective features for the improvement of a multimodal recommender system , 2009, CIVR '09.

[14]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Stefano Mizzaro Relevance: the whole history , 1997 .

[16]  Michael D. Rugg,et al.  Latencies of visually responsive neurons in various regions of the rhesus monkey brain and their relation to human visual responses , 1988, Biological Psychology.

[17]  Li Fei-Fei,et al.  Neural mechanisms of rapid natural scene categorization in human visual cortex , 2009, Nature.

[18]  Thorsten Joachims,et al.  Eye tracking and online search: Lessons learned and challenges ahead , 2008 .

[19]  P. Downing,et al.  Mapping brain activation and information during category-specific visual working memory. , 2012, Journal of neurophysiology.

[20]  Tefko Saracevic Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance , 2007 .

[21]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[22]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[23]  Ryen W. White Implicit feedback for interactive information retrieval , 2005, SIGF.

[24]  Thorsten Joachims,et al.  Accurately interpreting clickthrough data as implicit feedback , 2005, SIGIR '05.

[25]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[26]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[27]  Ryen W. White,et al.  A study on the effects of personalization and task information on implicit feedback performance , 2006, CIKM '06.

[28]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[29]  Ioannis Konstas,et al.  Using facial expressions and peripheral physiological signals as implicit indicators of topical relevance , 2009, ACM Multimedia.

[30]  Nicholas J. Belkin,et al.  A user modeling system for personalized interaction and tailored retrieval in interactive IR , 2005, ASIST.