"Fingers in the Nose": Evaluating Speakers' Identification of Multi-Word Expressions Using a Slightly Gamified Crowdsourcing Platform

This article presents the results we obtained in crowdsourcing French speakers' intuition concerning multi-work expressions (MWEs). We developed a slightly gamified crowdsourcing platform, part of which is designed to test users' ability to identify MWEs with no prior training. The participants perform relatively well at the task, with a recall reaching 65% for MWEs that do not behave as function words.

[1]  Udo Kruschwitz,et al.  Experiment-Driven Development of a GWAP for Marking Segments in Text , 2017, CHI PLAY.

[2]  Cvetana Krstev,et al.  Games on multiword expressions for community building , 2017 .

[3]  Nathan Schneider,et al.  SemEval-2016 Task 10: Detecting Minimal Semantic Units and their Meanings (DiMSUM) , 2016, *SEMEVAL.

[4]  D. Barr,et al.  Metaphor in Idiom Comprehension , 1997 .

[5]  Sampo Pyysalo,et al.  Universal Dependencies v1: A Multilingual Treebank Collection , 2016, LREC.

[6]  Mathieu Lafourcade,et al.  Making people play for Lexical Acquisition with the JeuxDeMots prototype , 2007 .

[7]  Nicolas Lefebvre,et al.  Crowdsourcing Complex Language Resources: Playing to Annotate Dependency Syntax , 2016, COLING.

[8]  Udo Kruschwitz,et al.  Phrase detectives: Utilizing collective intelligence for internet-scale language resource creation , 2013, TIIS.

[9]  R. Gibbs.  What do idioms really mean , 1992 .

[10]  Jean-Yves Antoine,et al.  Annotation d'expressions polylexicales verbales en français (Annotation of verbal multiword expressions in French) , 2017, TALN.

[11]  Adam Przepiórkowski,et al.  PARSEME – PARSing and Multiword Expressions within a European multilingual network , 2015 .

[12]  Behrang Q. Zadeh,et al.  The PARSEME Shared Task on Automatic Identification of Verbal Multiword Expressions , 2017, MWE@EACL.

[13]  Carlos Ramisch,et al.  How Naked is the Naked Truth? A Multilingual Lexicon of Nominal Compound Compositionality , 2016, ACL.

[14]  Timothy Baldwin,et al.  Multiword Expressions: A Pain in the Neck for NLP , 2002, CICLing.

[15]  Carlos Ramisch,et al.  Survey: Multiword Expression Processing: A Survey , 2017, CL.