Crowdsourced Evaluation of Semantic Patterns for Recommendation

In this paper we explore the use of semantics to improve diversity in recommendations. We use semantic patterns extracted from Linked Data sources to surface new connections between items to provide diverse recommendations to the end users. We evaluate this methodology by adopting a bottom-up approach, i.e. we ask users of a crowdsourcing platform to choose a movie recommendation from among five options. We evaluate the results in terms of a diversity measure based on the semantic distance of topics and genres of the result list. The results of the experiment indicate that there are features of semantic patterns that can be used as an indicator of its suitability for the recommendation process.

[1]  Markus Zanker,et al.  Linked open data to support content-based recommender systems , 2012, I-SEMANTICS '12.

[2]  Chris Welty,et al.  Crowd Truth: Harnessing disagreement in crowdsourcing a relation extraction gold standard , 2013 .

[3]  Martha Palmer,et al.  Verb Semantics and Lexical Selection , 1994, ACL.

[4]  Neil J. Hurley,et al.  Novelty and Diversity in Top-N Recommendation -- Analysis and Evaluation , 2011, TOIT.

[5]  Barry Smyth,et al.  Improving Recommendation Diversity , 2001 .

[6]  Elena Paslaru Bontas Simperl,et al.  CrowdMap: Crowdsourcing Ontology Alignment with Microtasks , 2012, SEMWEB.

[7]  C. Spearman The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[8]  Ferdinand Fuhrmann,et al.  Content-based music recommendation based on user preference examples , 2010, RecSys 2010.

[9]  Houda Oufaida Exploiting Semantic Web Technologies for Recommender Systems: A Multi View Recommendation Engine (Short Paper) , 2009, ITWP.

[10]  Aldo Gangemi,et al.  Towards a pattern science for the Semantic Web , 2010, Semantic Web.

[11]  Lora Aroyo,et al.  CHIP Demonstrator: Semantics-driven Recommendations and Museum Tour Generation , 2007, Semantic Web Challenge.

[12]  Philip S. Yu,et al.  PathSim , 2011, Proc. VLDB Endow..

[13]  Stuart E. Middleton,et al.  Ontological user profiling in recommender systems , 2004, TOIS.

[14]  Lora Aroyo,et al.  Extracting Core Knowledge from Linked Data , 2011, COLD.

[15]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[16]  Saul Vargas,et al.  Rank and relevance in novelty and diversity metrics for recommender systems , 2011, RecSys '11.