On the relation between dependency distance, crossing dependencies, and parsing. Comment on "Dependency distance: a new perspective on syntactic patterns in natural languages" by Haitao Liu et al

Liu et al. (2017) provide a comprehensive account of research on dependency distance in human languages. While the article is a very rich and useful report on this complex subject, here I will expand on a few specific issues where research in computational linguistics (specifically natural language processing) can inform DDM research, and vice versa. These aspects have not been explored much in the article by Liu et al. or elsewhere, probably due to the little overlap between both research communities, but they may provide interesting insights for improving our understanding of the evolution of human languages, the mechanisms by which the brain processes and understands language, and the construction of effective computer systems to achieve this goal.

[1]  Joakim Nivre,et al.  Algorithms for Deterministic Incremental Dependency Parsing , 2008, CL.

[2]  Carlos Gómez-Rodríguez.  Restricted Non-Projectivity: Coverage vs. Efficiency , 2016, Computational Linguistics.

[3]  Ramon Ferrer i Cancho,et al.  Euclidean distance between syntactically linked words. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  R. F. Cancho.  Euclidean distance between syntactically linked words. , 2004 .

[5]  Haitao Liu,et al.  Dependency Distance as a Metric of Language Comprehension Difficulty , 2008 .

[6]  Joakim Nivre,et al.  Divisible Transition Systems and Multiplanar Dependency Parsing , 2013, CL.

[7]  Joakim Nivre,et al.  Non-Projective Dependency Parsing in Expected Linear Time , 2009, ACL.

[8]  Michael A. Covington,et al.  A Fundamental Algorithm for Dependency Parsing , 2004 .

[9]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[10]  Edward Gibson,et al.  The processing of extraposed structures in English , 2012, Cognition.

[11]  Jirí Havelka.  Beyond Projectivity: Multilingual Evaluation of Constraints and Measures on Non-Projective Structures , 2007, ACL.

[12]  Yannick Versley,et al.  Experiments with Easy-first nonprojective constituent parsing , 2014 .

[13]  Eliyahu Kiperwasser,et al.  Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations , 2016, TACL.

[14]  Ramon Ferrer-i-Cancho,et al.  Are crossing dependencies really scarce? , 2017, ArXiv.

[15]  Joakim Nivre,et al.  Squibs: Arc-Eager Parsing with the Tree Constraint , 2014, CL.

[16]  Igor Mel’čuk,et al.  Dependency Syntax: Theory and Practice , 1987 .

[17]  Ramon Ferrer-i-Cancho,et al.  Non-crossing dependencies: least effort, not grammar , 2014, ArXiv.

[18]  David J. Weir,et al.  Dependency Parsing Schemata and Mildly Non-Projective Dependency Parsing , 2011, CL.

[19]  Ji Ma,et al.  SyntaxNet Models for the CoNLL 2017 Shared Task , 2017, ArXiv.

[20]  Carlos Gómez-Rodríguez,et al.  The scarcity of crossing dependencies: a direct outcome of a specific constraint? , 2016, Physical review. E.

[21]  Ramon Ferrer-i-Cancho,et al.  Crossings as a side effect of dependency lengths , 2015, Complex..

[22]  Rudolf Rosa,et al.  HamleDT 2.0: Thirty Dependency Treebanks Stanfordized , 2014, LREC.

[23]  Slav Petrov,et al.  Globally Normalized Transition-Based Neural Networks , 2016, ACL.

[24]  Giorgio Satta,et al.  Dynamic Programming Algorithms for Transition-Based Dependency Parsers , 2011, ACL.

[25]  Haitao Liu,et al.  Dependency distance: A new perspective on syntactic patterns in natural languages. , 2017, Physics of life reviews.

[26]  Joakim Nivre,et al.  Mildly Non-Projective Dependency Structures , 2006, ACL.

[27]  Richard Futrell,et al.  Large-scale evidence of dependency length minimization in 37 languages , 2015, Proceedings of the National Academy of Sciences.

[28]  Sampath Kannan,et al.  Finding Optimal 1-Endpoint-Crossing Trees , 2013, TACL.

[29]  Sampath Kannan,et al.  Dynamic Programming for Higher Order Parsing of Gap-Minding Trees , 2012, EMNLP.

[30]  Noah A. Smith,et al.  Parsing with Soft and Hard Constraints on Dependency Length , 2005, IWPT.

[31]  Noah A. Smith,et al.  Transition-Based Dependency Parsing with Stack Long Short-Term Memory , 2015, ACL.

[32]  Carlos Gómez-Rodríguez,et al.  Natural language processing and the Now-or-Never bottleneck , 2016, Behavioral and Brain Sciences.