Using DiAML and ANVIL for multimodal dialogue annotations

This paper shows how interoperable dialogue act annotations, using the multidimensional annotation scheme and the markup language DiAML of ISO standard 24617-2, can conveniently be obtained using the newly implemented facility in the ANVIL annotation tool to produce XML-based output directly in the DiAML format. ANVIL offers the use of multiple user-defined `tiers' for annotating various kinds of information. This is shown to be convenient not only for multimodal information but also for dialogue act annotation according to ISO standard 24617-2 because of the latter's multidimensionality: functional dialogue segments are viewed as expressing one or more dialogue acts, and every dialogue act belongs to one of a number of dimensions of communication, defined in the standard, for each of which a different ANVIL tier can conveniently be used. Annotations made in the multi-tier interface can be exported in the ISO 24617-2 format, thus supporting the creation of interoperable annotated corpora of multimodal dialogue.

[1]  H. Vilhjálmsson,et al.  Towards a Standard Markup Language for Embodied Dialogue Acts PROCEEDINGS I N CONJUNCTION WITH AAMAS 2009 , 2009 .

[2]  Nancy Ide,et al.  GrAF: A Graph-based Format for Linguistic Annotations , 2007, LAW@ACL.

[3]  Harry Bunt,et al.  'Who's next? Speaker-selection mechanisms in multiparty dialogue' , 2009 .

[4]  Harry Bunt,et al.  Anatomy of Annotation Schemes: Mapping to GrAF , 2010, Linguistic Annotation Workshop.

[5]  Harry Bunt,et al.  Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data , 2010, LREC.

[6]  Harry Bunt,et al.  Anatomy of semantic annotation schemes : Mappings to GrAF , 2010 .

[7]  Volha Petukhova.  Multidimensional dialogue modelling , 2006 .

[8]  Michael Kipp.  Multimedia Annotation , Querying and Analysis in ANVIL , 2009 .

[9]  Harry Bunt,et al.  The DIT++ taxanomy for functional dialogue markup , 2009 .

[10]  Andrei Popescu-Belis,et al.  Dialogue Acts: One or More Dimensions? , 2007 .

[11]  Kôiti Hasida,et al.  ISO 24617-2: A semantically-based standard for dialogue annotation , 2012, LREC.

[12]  Peter Wittenburg,et al.  ELAN: a Professional Framework for Multimodality Research , 2006, LREC.

[13]  Mark T. Maybury,et al.  Multimedia Annotation, Querying, and Analysis in Anvil , 2011 .

[14]  Harry Bunt,et al.  The Semantics of Dialogue Acts , 2011, IWCS.

[15]  Harry Bunt,et al.  A Multidimensional Approach to Utterance Segmentation and Dialogue Act Classification , 2007, SIGDIAL.

[16]  Kôiti Hasida,et al.  Semantic annotation framework (SemAF), Part 2: Dialogue acts. ISO Draft International Standard ISO 24617-2:2010 , 2010 .

[17]  Andrei Popescu-Belis.  Dimensionality of dialogue act tagsets , 2008, Lang. Resour. Evaluation.

[18]  James F. Allen,et al.  Draft of DAMSL Dialog Act Markup in Several Layers , 2007 .

[19]  Harry Bunt,et al.  Grounding by nodding , 2009 .

[20]  Nancy Ide,et al.  International Standard for a Linguistic Annotation Framework , 2003, Natural Language Engineering.

[21]  Thomas C. Schmidt.  Transcribing and annotating spoken language with EXMARaLDA , 2004 .

[22]  Andrei Popescu-Belis.  An empirical analysis of large corpora , 2008 .

[23]  Harry Bunt,et al.  Multifunctionality in dialogue , 2011, Comput. Speech Lang..

[24]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[25]  Kôiti Hasida,et al.  Towards an ISO Standard for Dialogue Act Annotation , 2010, LREC.

[26]  Harry Bunt,et al.  The coding and annotation of multimodal dialogue acts , 2012, LREC.

[27]  Harry Bunt,et al.  Incremental dialogue act understanding , 2011, IWCS.

[28]  Jean Carletta,et al.  HCRC dialogue structure coding manual , 1995 .

[29]  Michael Kipp.  Spatiotemporal Coding in ANVIL , 2008, LREC.