RU-EVAL-2019: EVALUATING ANAPHORA AND COREFERENCE RESOLUTION FOR RUSSIAN

RUSSIAN Budnikov E. A.* (egor.budnikov@abbyy.com), Toldova S. Yu.* (toldova@yandex.ru), Zvereva D. S.*** (zverevads@gmail.com), Maximova D. M. ** (daria.maximova.m@gmail.com), Ionov M. I.**** (max.ionov@gmail.com) * ABBYY, Moscow, Russia ** National Research University Higher School of Economics, Moscow, Russia *** Moscow Institute of Physics and Technology, Moscow, Russia **** Goethe University Frankfurt, Frankfurt am Main, Russia

[1]  Chen Chen,et al.  Linguistically Aware Coreference Evaluation Metrics , 2013, IJCNLP.

[2]  Massimo Poesio,et al.  The VENEX corpus of anaphora and deixis in spoken and written Italian , 2004 .

[3]  Michael Strube,et al.  Evaluation Metrics For End-to-End Coreference Resolution Systems , 2010, SIGDIAL Conference.

[4]  Druzhkin K. Ju.  Syntactic and Semantic parSer baSed on abbyy compreno linguiStic technologieS , 2012 .

[5]  Christian Chiarcos,et al.  PoCoS - Potsdam Coreference Scheme , 2007, LAW@ACL.

[6]  Kees van Deemter,et al.  On Coreferring: Coreference in MUC and Related Annotation Schemes , 2000, CL.

[7]  Ralph Grishman,et al.  Message Understanding Conference- 6: A Brief History , 1996, COLING.

[8]  Lynette Hirschman,et al.  A Model-Theoretic Coreference Scoring Scheme , 1995, MUC.

[9]  Helmut Schmidt,et al.  Probabilistic part-of-speech tagging using decision trees , 1994 .

[10]  Breck Baldwin,et al.  Entity-Based Cross-Document Coreferencing Using the Vector Space Model , 1998, COLING.

[11]  Michael Strube,et al.  Which Coreference Evaluation Metric Do You Trust? A Proposal for a Link-based Entity Aware Metric , 2016, ACL.

[12]  Olga Lyashevskaya,et al.  RU-EVAL-2012: Evaluating Dependency Parsers for Russian , 2012, COLING.

[13]  Skorinkin Daniil,et al.  Anaphora Analysis based on ABBYY Compreno Linguistic Technologies , 2014 .

[14]  Christopher D. Manning,et al.  Entity-Centric Coreference Resolution with Model Stacking , 2015, ACL.

[15]  Manfred Stede,et al.  The Potsdam Commentary Corpus , 2004, ACL 2004.

[16]  Xiaoqiang Luo,et al.  On Coreference Resolution Performance Metrics , 2005, HLT.

[17]  M E Stepanova,et al.  Information Extraction Based on Deep Syntactic-Semantic Analysis , 2016 .

[18]  Ron Artstein,et al.  Anaphoric Annotation in the ARRAU Corpus , 2008, LREC.

[19]  Breck Baldwin,et al.  Algorithms for Scoring Coreference Chains , 1998 .

[20]  Stefanie Dipper,et al.  Annotating abstract anaphora , 2012, Lang. Resour. Evaluation.

[21]  Yuchen Zhang,et al.  CoNLL-2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes , 2012, EMNLP-CoNLL Shared Task.

[22]  Mitchell P. Marcus,et al.  OntoNotes: The 90% Solution , 2006, NAACL.

[23]  Michael Strube,et al.  Multi-Level Annotation in MMAX , 2003, SIGDIAL Workshop.

[24]  R. Mitkov.  ANAPHORA RESOLUTION: THE STATE OF THE ART , 2007 .

[25]  Michael Strube,et al.  Latent Structures for Coreference Resolution , 2015, TACL.

[26]  Maria Vasilyeva,et al.  Evaluating Anaphora and Coreference Resolution for Russian , 2014 .

[27]  Petr Pajas,et al.  The Coding Scheme for Annotating Extended Nominal Coreference and Bridging Anaphora in the Prague Dependency Treebank , 2009, Linguistic Annotation Workshop.

[28]  Mateusz Kopec,et al.  Polish Coreference Corpus , 2013, LTC.

[29]  Jan Hajic,et al.  The Prague Dependency Treebank , 2003 .

[30]  Massimo Poesio,et al.  Evalita 2011: Anaphora Resolution Task , 2011, EVALITA.

[31]  Xabier Arregi,et al.  Coreference Resolution for Morphologically Rich Languages. Adaptation of the Stanford System to Basque , 2015, Proces. del Leng. Natural.

[32]  Mariya V. Khudyakova.  Computational Modeling Of Referential Choice : Major And Minor Referential Options , 2011 .

[33]  Hercules Dalianis,et al.  Automatic training of lemmatization rules that handle morphological changes in pre-, in- and suffixes alike , 2009, ACL.

[34]  Kristina Nilsson Björkenstam,et al.  SUC-CORE: SUC 2.0 Annotated with NP Coreference , 2012 .