The search dashboard: how reflection and comparison impact search behavior

Most searchers do not know how to use Web search engines as effectively as possible. This is due, in part, to search engines not providing feedback about how search behavior can be improved. Because feedback is an essential part of learning, we created the Search Dashboard, which provides an interface for reflection on personal search behavior. The Dashboard aggregates and presents an individual's search history and provides comparisons with that of archetypal expert profiles. Via a five-week study of 90 Search Dash-board users, we find that users are able to change aspects of their behavior to be more in line with that of the presented expert searchers. We also find that reflection can be beneficial, even without comparison, by changing participants' views about their own search skills, what is possible with search, and what aspects of their behavior may influence search success. Our findings demonstrate a new way for search engines to help users modify their search behavior for positive outcomes.

[1]  Dan Morris,et al.  ClassSearch: facilitating the development of web search skills through social learning , 2011, CHI.

[2]  Kazuhisa Miwa,et al.  A cognitive study of information seeking processes in the WWW: the effects of searcher's knowledge and experience , 2001, Proceedings of the Second International Conference on Web Information Systems Engineering.

[3]  Susan T. Dumais,et al.  Classification-enhanced ranking , 2010, WWW '10.

[4]  Dan Morris,et al.  SearchBar: a search-centric web history for task resumption and information re-finding , 2008, CHI.

[5]  D. Boud,et al.  Reflection, turning experience into learning , 1985 .

[6]  Jodi Forlizzi,et al.  Know thyself: monitoring and reflecting on facets of one's life , 2010, CHI Extended Abstracts.

[7]  Ji-Rong Wen,et al.  WWW 2007 / Track: Search Session: Personalization A Largescale Evaluation and Analysis of Personalized Search Strategies ABSTRACT , 2022 .

[8]  G. Kalyanaram,et al.  Nudge: Improving Decisions about Health, Wealth, and Happiness , 2011 .

[9]  Ed H. Chi,et al.  An elaborated model of social search , 2010, Inf. Process. Manag..

[10]  Saskia Brand-Gruwel,et al.  Information problem solving by experts and novices: analysis of a complex cognitive skill , 2005, Comput. Hum. Behav..

[11]  Ryen W. White,et al.  Characterizing the influence of domain expertise on web search behavior , 2009, WSDM '09.

[12]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[13]  David Mease,et al.  Measuring improvement in user search performance resulting from optimal search tips , 2011, SIGIR '11.

[14]  Klaus Nordhausen,et al.  Modeling successful performance in Web searching , 2006 .

[15]  David R. Karger,et al.  Eyebrowse: real-time web activity sharing and visualization , 2010, CHI Extended Abstracts.

[16]  Karen Spärck Jones.  A statistical interpretation of term specificity and its application in retrieval , 2021, J. Documentation.

[17]  Mika Käki,et al.  Information search and re-access strategies of experienced web users , 2005, WWW '05.

[18]  James A. Landay,et al.  The design of eco-feedback technology , 2010, CHI.

[19]  Anne Aula,et al.  How does search behavior change as search becomes more difficult? , 2010, CHI.

[20]  Karen Sparck Jones.  A statistical interpretation of term specificity and its application in retrieval , 1972 .

[21]  David W. McDonald,et al.  Theory-driven design strategies for technologies that support behavior change in everyday life , 2009, CHI.

[22]  Christoph Hölscher,et al.  Web search behavior of Internet experts and newbies , 2000, Comput. Networks.

[23]  B. J. Fogg,et al.  Motivating, influencing, and persuading users , 2002 .

[24]  Neesha Kodagoda,et al.  Effects of low & high literacy on user performance in information search and retrieval , 2008 .

[25]  A. Bandura.  Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[26]  Dan Morris,et al.  Investigating the querying and browsing behavior of advanced search engine users , 2007, SIGIR.

[27]  Craig Locatis,et al.  Searching through cyberspace: the effects of link display and link density on information retrieval from hypertext on the World Wide Web , 1998 .

[28]  Ryen W. White,et al.  Studying the use of popular destinations to enhance web search interaction , 2007, SIGIR.

[29]  R. Thaler,et al.  Nudge: Improving Decisions About Health, Wealth, and Happiness , 2008 .

[30]  Iwan G. J. H. Wopereis,et al.  Differences between novice and experienced users in searching information on the World Wide Web , 2000, J. Am. Soc. Inf. Sci..