Goal Relevance as a Quantitative Model of Human Task Relevance

The concept of relevance is used ubiquitously in everyday life. However, a general quantitative definition of relevance has been lacking, especially as pertains to quantifying the relevance of sensory observations to one’s goals. We propose a theoretical definition for the information value of data observations with respect to a goal, which we call “goal relevance.” We consider the probability distribution of an agent’s subjective beliefs over how a goal can be achieved. When new data are observed, its goal relevance is measured as the Kullback-Leibler divergence between belief distributions before and after the observation. Theoretical predictions about the relevance of different obstacles in simulated environments agreed with the majority response of 38 human participants in 83.5% of trials, beating multiple machine-learning models. Our new definition of goal relevance is general, quantitative, explicit, and allows one to put a number onto the previously elusive notion of relevance of observations to a goal.

[1]  Jitendra Malik,et al.  An Information Maximization Model of Eye Movements , 2004, NIPS.

[2]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[3]  Puiu F. Balan,et al.  Attention as a decision in information space , 2010, Trends in Cognitive Sciences.

[4]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[5]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[6]  Stephen E. Robertson,et al.  Optimisation methods for ranking functions with multiple parameters , 2006, CIKM '06.

[7]  M. E. Maron,et al.  On Relevance, Probabilistic Indexing and Information Retrieval , 1960, JACM.

[8]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[9]  George L. Malcolm,et al.  Combining top-down processes to guide eye movements during real-world scene search. , 2010, Journal of vision.

[10]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[11]  V. Lavrenko,et al.  Relevance Feedback Between Hypertext and Semantic Search , 2009 .

[12]  Laurent Itti,et al.  Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[14]  Nancy M. Amato,et al.  A randomized roadmap method for path and manipulation planning , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Mary M Hayhoe,et al.  Task and context determine where you look. , 2016, Journal of vision.

[17]  Ingemar J. Cox,et al.  An optimized interaction strategy for Bayesian relevance feedback , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  D. Sperber,et al.  Truthfulness and Relevance , 2002 .

[19]  Dana H. Ballard,et al.  Eye Movements for Reward Maximization , 2003, NIPS.

[20]  Alexander L. Churchill,et al.  Twitter Relevance Filtering via Joint Bayes Classifiers from User Clustering , 2010 .

[21]  Philip S. Yu,et al.  Is random model better? On its accuracy and efficiency , 2003, Third IEEE International Conference on Data Mining.

[22]  D. Ballard,et al.  Modeling Task Control of Eye Movements , 2014, Current Biology.

[23]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[24]  Amy Nicole Langville,et al.  Google's PageRank and beyond - the science of search engine rankings , 2006 .

[25]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[26]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[27]  A. Cabrales,et al.  Entropy and the Value of Information for Investors , 2010 .

[28]  Ali Borji,et al.  What/Where to Look Next? Modeling Top-Down Visual Attention in Complex Interactive Environments , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  Jade Goldstein-Stewart,et al.  The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries , 1998, SIGIR Forum.

[30]  R. C. Langford How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[31]  D. Ballard,et al.  The role of uncertainty and reward on eye movements in a virtual driving task. , 2012, Journal of vision.

[32]  Jonathan D. Nelson,et al.  Experience Matters , 2010, Psychological science.

[33]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[34]  Birger Hjørland,et al.  Work tasks and socio-cognitive relevance: A specific example , 2002, J. Assoc. Inf. Sci. Technol..

[35]  Gerd Gigerenzer,et al.  Why Heuristics Work , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[36]  Birger Hjørland The foundation of the concept of relevance , 2010 .

[37]  Bernard J. Jansen,et al.  Coverage, relevance, and ranking: The impact of query operators on Web search engine results , 2003, TOIS.

[38]  D. Sperber,et al.  Relevance: Communication and Cognition , 1997 .

[39]  Stephen E. Robertson,et al.  Relevance weighting of search terms , 1976, J. Am. Soc. Inf. Sci..

[40]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[41]  Steven M. LaValle,et al.  Incrementally reducing dispersion by increasing Voronoi bias in RRTs , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[42]  A. L. Yarbus Eye Movements During Perception of Complex Objects , 1967 .

[43]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[44]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[45]  D. Sperber,et al.  Relevance: Communication and Cognition , 1989 .

[46]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[47]  R. Kapuściński,et al.  Value of Information in Capacitated Supply Chains , 1999 .

[48]  Michael L. Mack,et al.  Viewing task influences eye movement control during active scene perception. , 2009, Journal of vision.