Evaluation of Semantic Dependency Labeling Across Domains

One of the key concerns in computational semantics is to construct a domain independent semantic representation which captures the richness of natural language, yet can be quickly customized to a specific domain for practical applications. We propose to use generic semantic frames defined in FrameNet, a domain-independent semantic resource, as an intermediate semantic representation for language understanding in dialog systems. In this paper we: (a) outline a novel method for FrameNet-style semantic dependency labeling that builds on a syntactic dependency parse; and (b) compare the accuracy of domain-adapted and generic approaches to semantic parsing for dialog tasks, using a frame-annotated corpus of human-computer dialogs in an airline reservation domain.

[1]  Richard Johansson,et al.  The CoNLL 2008 Shared Task on Joint Parsing of Syntactic and Semantic Dependencies , 2008, CoNLL.

[2]  Roberto Basili,et al.  Semantic Tree Kernels for Statistical Natural Language Learning , 2015, Italian Natural Language Processing within the PARLI Project.

[3]  Richard Johansson,et al.  LTH: Semantic Structure Extraction using Nonprojective Dependency Trees , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[4]  Alexander Yates,et al.  Open-Domain Semantic Role Labeling by Modeling Word Spans , 2010, ACL.

[5]  Kuzman Ganchev,et al.  Efficient Inference and Structured Learning for Semantic Role Labeling , 2015, TACL.

[6]  Roberto Basili,et al.  Effective and Robust Natural Language Understanding for Human-Robot Interaction , 2014, ECAI.

[7]  Luke S. Zettlemoyer,et al.  Bootstrapping Semantic Parsers from Conversations , 2011, EMNLP.

[8]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[9]  Gregory A. Sanders,et al.  DARPA communicator dialog travel planning systems: the june 2000 data collection , 2001, INTERSPEECH.

[10]  Mirella Lapata,et al.  Similarity-Driven Semantic Role Induction via Graph Partitioning , 2014, CL.

[11]  Neville Ryant,et al.  A large-scale classification of English verbs , 2008, Lang. Resour. Evaluation.

[12]  Alessandro Moschitti,et al.  Automatic framenet-based annotation of conversational speech , 2008, 2008 IEEE Spoken Language Technology Workshop.

[13]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[14]  Geoffrey Zweig,et al.  Fast and easy language understanding for dialog systems with Microsoft Language Understanding Intelligent Service (LUIS) , 2015, SIGDIAL Conference.

[15]  Alexander I. Rudnicky,et al.  Unsupervised induction and filling of semantic slots for spoken dialogue systems using frame-semantic parsing , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[16]  Xavier Carreras,et al.  Introduction to the CoNLL-2005 Shared Task: Semantic Role Labeling , 2005, CoNLL.

[17]  Dilek Z. Hakkani-Tür,et al.  Semi-supervised learning for spoken language understanding semantic role labeling , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[18]  Dan Roth,et al.  The Importance of Syntactic Parsing and Inference in Semantic Role Labeling , 2008, CL.

[19]  J. Lowe,et al.  A Frame-Semantic Approach to Semantic Annotation , 1997 .

[20]  Owen Rambow,et al.  The Dependency-Parsed FrameNet Corpus , 2012, LREC.

[21]  Alessandro Moschitti,et al.  Shallow Semantic Parsing for Spoken Language Understanding , 2009, NAACL.

[22]  James F. Allen,et al.  Linking Semantic and Knowledge Representations in a Multi-Domain Dialogue System , 2008, J. Log. Comput..