Overview of the CLEF 2016 Social Book Search Lab

The Social Book Search (SBS) Lab investigates book search in scenarios where users search with more than just a query, and look for more than objective metadata. Real-world information needs are generally complex, yet almost all research focuses instead on either relatively simple search based on queries, or on profile-based recommendation. The goal is to research and develop techniques to support users in complex book search tasks. The SBS Lab has three tracks. The aim of the Suggestion Track is to develop test collections for evaluating ranking effectiveness of book retrieval and recommender systems. The aim of the Interactive Track is to develop user interfaces that support users through each stage during complex search tasks and to investigate how users exploit professional metadata and user-generated content. The Mining Track focuses on detecting and linking book titles in online book discussion forums, as well as detecting book search research in forum posts for automatic book recommendation.

[1]  Elaine Toms,et al.  Building a Common Framework for IIR Evaluation , 2013, CLEF.

[2]  Norbert Fuhr,et al.  Overview and Results of the INEX 2009 Interactive Track , 2010, ECDL.

[3]  E. Toms,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[4]  Peter Ingwersen,et al.  The development of a method for the evaluation of interactive information retrieval systems , 1997, J. Documentation.

[5]  Elaine Toms,et al.  Overview of the CLEF 2016 Social Book Search Lab , 2015, CLEF.

[6]  Kara Reuter.  Assessing aesthetic relevance: Children's book selection in a digital library , 2007 .

[7]  Jaap Kamps,et al.  Looking for Books in Social Media: An Analysis of Complex Search Requests , 2015, ECIR.

[8]  Elaine Toms,et al.  The CHiC Interactive Task (CHiCi) at CLEF2013 , 2013, CLEF.

[9]  Gabriella Kazai,et al.  Social book search: comparing topical relevance judgements and book suggestions for evaluation , 2012, CIKM.

[10]  Eneko Agirre,et al.  Evaluating hierarchical organisation structures for exploring digital libraries , 2014, Information Retrieval.

[11]  Carol Collier Kuhlthau.  Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[12]  Gabriella Kazai,et al.  Social Book Search: The Impact of Professional and User-Generated Content on Book Suggestions , 2013, DIR.

[13]  Pertti Vakkari,et al.  A theory of the task-based information retrieval process: a summary and generalisation of a longitudinal study , 2001, J. Documentation.