LR Recursive Transition Networks for Earley and Tomita Parsing

Efficient syntactic and semantic parsing for ambiguous context-free languages are generally characterized as complex, specialized, highly formal algorithms. In fact, they are readily constructed from straightforward recursive transition networks (RTNs). In this paper, we introduce LR-RTNs, and then computationally motivate a uniform progression from basic LR parsing, to Earley's (chart) parsing, concluding with Tomita's parser. These apparently disparate algorithms are unified into a single implementation, which was used to automatically generate all the figures in this paper.

[1]  William A. Woods,et al.  Computational Linguistics Transition Network Grammars for Natural Language Analysis , 2022 .

[2]  Paul Klint,et al.  Incremental generation of parsers , 1989, PLDI '89.

[3]  Jay Earley,et al.  An efficient context-free parsing algorithm , 1970, Commun. ACM.

[4]  Franklin L. DeRemer,et al.  Simple LR(k) grammars , 1971, Commun. ACM.

[5]  Masaru Tomita,et al.  Efficient Parsing for Natural Language: A Fast Algorithm for Practical Systems , 1985 .

[6]  Masaru Tomita,et al.  Efficient parsing for natural language , 1985 .

[7]  Mihai Nadin T. Winograd, Language as a Cognitive Process, Volume I: Syntax , 1985, Artif. Intell..

[8]  Jay Earley,et al.  An efficient context-free parsing algorithm , 1970, Commun. ACM.

[9]  Terry Winograd,et al.  Language as a Cognitive Process , 1983, CL.

[10]  Masaru Tomita,et al.  An Efficient Context-Free Parsing Algorithm for Natural Languages , 1985, IJCAI.

[11]  Donald E. Knuth,et al.  On the Translation of Languages from Left to Right , 1965, Inf. Control..

[12]  Terry Winograd,et al.  Language as a cognitive process 1: Syntax , 1982 .

[13]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[14]  Alfred V. Aho,et al.  Compilers: Principles, Techniques, and Tools , 1986, Addison-Wesley series in computer science / World student series edition.

[15]  Bernard Lang,et al.  Towards a Uniform Formal Framework for Parsing , 1991 .

[16]  Mark W. Perlin,et al.  Call-Graph Caching: Transforming Programs into Networks , 1989, IJCAI.

[17]  Mark W. Perlin,et al.  RETE and chart parsing from bottom-up call-graph caching , 1991, [Proceedings] Third International Conference on Tools for Artificial Intelligence - TAI 91.