Say it with Emojis: Co-designing Relevance Cues for Searching in the Classroom

Search Engine Result Pages (SERP) include snippets of retrieved resources as a means to help searchers select the ones that satisfy their information needs. This way, result relevance can be determined by scanning through snippets, an exercise that requires experience with reading, understanding, and assessing the value of a document. These are skills that primary school children are still developing and thus are not yet proficient with. As web search tools are essential to support children learning at school and home, we explore how to help young searchers in making informed relevance assessments while conducting searches in a classroom. In this paper, we describe a collaborative design exercise involving primary school children as co-designers: we asked them to examine interfaces with combinations of different emojis to help them assess the usefulness of results in SERP–a crucial factor to determine relevance for the classroom. This activity made our child experts engage with the design exercise while enabling us to collect their judgments so as to get a better sense of the user requirements for this age group. Here we discuss the main design issues emerging from the analysis of children’s preferences, the rationale behind them, comments and concerns raised, and alternative proposals children sketched.

[1]  Ole Iversen,et al.  Child as Protagonist: Expanding the Role of Children in Participatory Design , 2017, IDC.

[2]  Evan Golub,et al.  Stranger Danger!: Social Media App Features Co-designed with Children to Keep Them Safe Online , 2019, IDC.

[3]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[4]  Peggy Gregory,et al.  An Investigation of Participatory Design with Children – Informant, Balanced and Facilitated Design , 2002 .

[5]  Jacek Gwizdka,et al.  Analysis of Children's Queries and Click Behavior on Ranked Results and Their Thought Processes in Google Search , 2017, CHIIR.

[6]  Monica Landoni,et al.  With a Little Help from my Friends: Use of Recommendations at School , 2019, RecSys.

[7]  Marilyn Hughes Blackmon,et al.  Cognitive walkthrough for the web , 2002, CHI.

[8]  Annika Hinze,et al.  A study of children's search query formulation habits , 2017, BCS HCI.

[9]  Allison Druin,et al.  Cooperative inquiry: developing new technologies for children with children , 1999, CHI '99.

[10]  L. Gibbs,et al.  Using Emoji in Research with Children and Young People: Because We Can? , 2018 .

[11]  Pieter Jan Stappers,et al.  Design research by proxy: using children as researchers to gain contextual knowledge about user experience. , 2013, CHI.

[12]  Jerry Alan Fails,et al.  Query Formulation Assistance for Kids: What is Available, When to Help & What Kids Want , 2019, IDC.

[13]  Janet C. Read,et al.  Giving ideas an equal chance: inclusion and representation in participatory design with children , 2014, IDC.

[14]  Janet C. Read,et al.  Can children perform a heuristic evaluation? , 2013, APCHI.

[15]  Jacek Gwizdka,et al.  Children's query types and reformulations in Google search , 2018, Inf. Process. Manag..

[16]  Dania Bilal,et al.  Children's use of the Yahooligans! Web search engine: I. Cognitive, physical, and affective behaviors on fact-based search tasks , 2000, J. Am. Soc. Inf. Sci..

[17]  J. Verwaeren,et al.  Emoji as a tool for measuring children’s emotions when tasting food , 2018, Food Quality and Preference.

[18]  Tatiana Gossen,et al.  Search Engines for Children - Search User Interfaces and Information-Seeking Behaviour , 2016 .

[19]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[20]  Stefan Siersdorfer,et al.  Dear search engine: what's your opinion about...?: sentiment analysis for semantic enrichment of web search results , 2010, SEMSEARCH '10.

[21]  Elisa Rubegni,et al.  How Many Roles Can Children Play? , 2016, IDC.

[22]  Pieter Jan Stappers,et al.  Children as coresearchers: more than just a roleplay , 2014, IDC.

[23]  Elizabeth Foss,et al.  How children search the internet with keyword interfaces , 2009, IDC.

[24]  Lisa Gibbs,et al.  Exploring the use of emoji as a visual research method for eliciting young children’s voices in childhood research , 2018 .

[25]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[26]  Monica Landoni,et al.  Sonny, Cerca! Evaluating the Impact of Using a Vocal Assistant to Search at School , 2019, CLEF.

[27]  Maria Soledad Pera,et al.  An empirical analysis of search engines' response to web search queries associated with the classroom setting , 2019, Aslib J. Inf. Manag..

[28]  Andreas Nürnberger,et al.  A comparative study about children's and adults' perception of targeted web search engines , 2014, CHI.

[29]  Eni Mustafaraj,et al.  Investigating the Effects of Google's Search Engine Result Page in Evaluating the Credibility of Online News Sources , 2018, WebSci.

[30]  Dania Bilal,et al.  Readability and word complexity of SERPs snippets and web pages on children's search queries , 2019, Aslib J. Inf. Manag..

[31]  Maria Soledad Pera,et al.  Looking for the Movie Seven or Sven from the Movie Frozen?: A Multi-perspective Strategy for Recommending Queries for Children , 2018, CHIIR.

[32]  Dania Bilal,et al.  Differences and similarities in information seeking: children and adults as Web users , 2002, Inf. Process. Manag..