暂无分享,去创建一个
[1] Timothy Baldwin,et al. Continuous Measurement Scales in Human Evaluation of Machine Translation , 2013, LAW@ACL.
[2] Sameer Singh,et al. Are Red Roses Red? Evaluating Consistency of Question-Answering Models , 2019, ACL.
[3] D. Sculley,et al. The Data Linter: Lightweight Automated Sanity Checking for ML Data Sets , 2017 .
[4] Interrater Disagreement Resolution: A Systematic Procedure to Reach Consensus in Annotation Tasks , 2021, HUMEVAL.
[5] Timothy Baldwin,et al. Is Machine Translation Getting Better over Time? , 2014, EACL.
[6] Nir Shavit,et al. Deep Learning is Robust to Massive Label Noise , 2017, ArXiv.
[7] Matthew Richardson,et al. MCTest: A Challenge Dataset for the Open-Domain Machine Comprehension of Text , 2013, EMNLP.
[8] Gerhard Weikum,et al. Robust Disambiguation of Named Entities in Text , 2011, EMNLP.
[9] Tim Weninger,et al. Reddit Entity Linking Dataset , 2021, ArXiv.
[10] Praveen K. Paritosh,et al. “Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI , 2021, CHI.
[11] Percy Liang,et al. Know What You Don’t Know: Unanswerable Questions for SQuAD , 2018, ACL.
[12] Justin Zobel,et al. How reliable are the results of large-scale information retrieval experiments? , 1998, SIGIR '98.
[13] Ming-Wei Chang,et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.
[14] Christopher Potts,et al. Learning Word Vectors for Sentiment Analysis , 2011, ACL.
[15] Ying Zhu,et al. Image segmentation evaluation: a survey of methods , 2020, Artificial Intelligence Review.
[16] Aidan Hogan,et al. Fine-Grained Evaluation for Entity Linking , 2019, EMNLP/IJCNLP.
[17] Thomas Hofmann,et al. Deep Joint Entity Disambiguation with Local Neural Attention , 2017, EMNLP.
[18] Zhiyi Ma,et al. Dynabench: Rethinking Benchmarking in NLP , 2021, NAACL.
[19] Yoav Goldberg,et al. Split and Rephrase: Better Evaluation and a Stronger Baseline , 2018, ACL.
[20] Axel-Cyrille Ngonga Ngomo,et al. GERBIL - Benchmarking Named Entity Recognition and Linking consistently , 2017, Semantic Web.
[21] Chin-Yew Lin,et al. ROUGE: A Package for Automatic Evaluation of Summaries , 2004, ACL 2004.
[22] Roland Vollgraf,et al. Contextual String Embeddings for Sequence Labeling , 2018, COLING.
[23] Jonas Mueller,et al. Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks , 2021, NeurIPS Datasets and Benchmarks.
[24] Thomas Hofmann,et al. End-to-End Neural Entity Linking , 2018, CoNLL.
[25] Yonatan Belinkov,et al. Synthetic and Natural Noise Both Break Neural Machine Translation , 2017, ICLR.
[26] Zhaochen Guo,et al. Robust Entity Linking via Random Walks , 2014, CIKM.
[27] Yoav Goldberg,et al. Breaking NLI Systems with Sentences that Require Simple Lexical Inferences , 2018, ACL.
[28] Rachel Rudinger,et al. Hypothesis Only Baselines in Natural Language Inference , 2018, *SEMEVAL.
[29] Omer Levy,et al. Improving Distributional Similarity with Lessons Learned from Word Embeddings , 2015, TACL.
[30] Antske Fokkens,et al. Would you describe a leopard as yellow? Evaluating crowd-annotations with justified and informative disagreement , 2020, COLING.
[31] Krisztian Balog,et al. REL: An Entity Linker Standing on the Shoulders of Giants , 2020, SIGIR.
[32] Heiko Paulheim,et al. Evaluating Entity Linking: An Analysis of Current Benchmark Datasets and a Roadmap for Doing a Better Job , 2016, LREC.
[33] Neural Entity Linking: A Survey of Models based on Deep Learning , 2020, ArXiv.
[34] Ilya Sutskever,et al. Language Models are Unsupervised Multitask Learners , 2019 .
[35] Christopher Potts,et al. A large annotated corpus for learning natural language inference , 2015, EMNLP.
[36] Sameer Singh,et al. Beyond Accuracy: Behavioral Testing of NLP Models with CheckList , 2020, ACL.
[37] Ivan Titov,et al. Improving Entity Linking by Modeling Latent Relations between Mentions , 2018, ACL.
[38] Aidan Hogan,et al. NIFify: Towards Better Quality Entity Linking Datasets , 2019, WWW.
[39] Mohit Bansal,et al. Robustness Gym: Unifying the NLP Evaluation Landscape , 2021, NAACL.
[40] Salim Roukos,et al. Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.
[41] Yejin Choi,et al. Story Cloze Task: UW NLP System , 2017, LSDSem@EACL.
[42] Scott Lundberg,et al. A Unified Approach to Interpreting Model Predictions , 2017, NIPS.
[43] Masatoshi Tsuchiya,et al. Performance Impact Caused by Hidden Bias of Training Data for Recognizing Textual Entailment , 2018, LREC.
[44] Yoav Goldberg,et al. Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets , 2019, EMNLP.
[45] Omer Levy,et al. Annotation Artifacts in Natural Language Inference Data , 2018, NAACL.
[46] Jian Zhang,et al. SQuAD: 100,000+ Questions for Machine Comprehension of Text , 2016, EMNLP.
[47] Margaret Mitchell,et al. Perturbation Sensitivity Analysis to Detect Unintended Model Biases , 2019, EMNLP.
[48] Jae-Gil Lee,et al. Learning from Noisy Labels with Deep Neural Networks: A Survey , 2020, ArXiv.
[49] C. Whan Park,et al. Choosing What I Want versus Rejecting What I Do Not Want: An Application of Decision Framing to Product Option Choice Decisions , 2000 .
[50] Philip Bachman,et al. NewsQA: A Machine Comprehension Dataset , 2016, Rep4NLP@ACL.
[51] Udo Kruschwitz,et al. Comparing Bayesian Models of Annotation , 2018, TACL.
[52] Samuel R. Bowman,et al. What Will it Take to Fix Benchmarking in Natural Language Understanding? , 2021, NAACL.