WASA: A Web Application for Sequence Annotation

Data annotation is an important and necessary task for all NLP applications. Designing and implementing a web-based application that enables many annotators to annotate and enter their input into one central database is not a trivial task. These kinds of web-based applications require a consistent and robust backup for the underlying database and support to enhance the efficiency and speed of the annotation. Also, they need to ensure that the annotations are stored with a minimal amount of redundancy in order to take advantage of the available resources(e.g, storage space). In this paper, we introduce WASA, a web-based annotation system for managing large-scale multilingual Code Switching (CS) data annotation. Although WASA has the ability to perform the annotation for any token sequence with arbitrary tag sets, we will focus on how WASA is used for CS annotation. The system supports concurrent annotation, handles multiple encodings, allows for several levels of management control, and enables quality control measures while seamlessly reporting annotation statistics from various perspectives and at different levels of granularity. Moreover, the system is integrated with a robust language specific date prepossessing tool to enhance the speed and efficiency of the annotation. We describe the annotation and the administration interfaces as well as the backend engine.

[1]  Mona T. Diab,et al.  AIDA2: A Hybrid Approach for Token and Sentence Level Dialect Identification in Arabic , 2015, CoNLL.

[2]  Lucia Specia,et al.  PET: a Tool for Post-editing and Assessing Machine Translation , 2012, LREC.

[3]  Arthur Stutt,et al.  MnM: Ontology Driven Semi-automatic and Automatic Support for Semantic Markup , 2002, EKAW.

[4]  Mona T. Diab,et al.  COLABA : Arabic Dialect Annotation and Processing , 2011 .

[5]  Iryna Gurevych,et al.  WebAnno: A Flexible, Web-based and Visually Supported System for Distributed Annotations , 2013, ACL.

[6]  Markus Dickinson,et al.  Annotating Errors in a Hungarian Learner Corpus , 2012, LREC.

[7]  Kalina Bontcheva,et al.  Developing Language Processing Components with GATE (a User Guide) , 2003 .

[8]  Marja-Riitta Koivunen,et al.  Annotea: an open RDF infrastructure for shared Web annotations , 2001, WWW '01.

[9]  Mona T. Diab,et al.  A Web Application for Dialectal Arabic Text Annotation , 2011 .

[10]  Mona T. Diab,et al.  Creating a Large Multi-Layered Representational Repository of Linguistic Code Switched Arabic Data , 2016, LREC.

[11]  Niraj Aswani,et al.  Designing a General Framework for Text Alignment: Case Studies with Two South Asian Languages , 2012 .

[12]  Kalina Bontcheva,et al.  Developing Language Processing Components with GATE Version 5 (a User Guide) , 2010 .

[13]  Laura Kallmeyer,et al.  SAWT: Sequence Annotation Web Tool , 2016, CodeSwitch@EMNLP.

[14]  Nizar Habash,et al.  SPLIT: Smart Preprocessing (Quasi) Language Independent Tool , 2016, LREC.