Lexical Quantile-Based Text Complexity Measure

This paper introduces a new approach to estimating the text document complexity. Common readability indices are based on average length of sentences and words. In contrast to these methods, we propose to count the number of rare words occurring abnormally often in the document. We use the reference corpus of texts and the quantile approach in order to determine what words are rare, and what frequencies are abnormal. We construct a general text complexity model, which can be adjusted for the specific task, and introduce two special models. The experimental design is based on a set of thematically similar pairs of Wikipedia articles, labeled using crowdsourcing. The experiments demonstrate the competitiveness of the proposed approach.

[1]  Raphaël Troncy,et al.  A Survey of Definitions and Models of Exploratory Search , 2017, ESIDA@IUI.

[2]  E A Smith,et al.  Automated readability index. , 1967, AMRL-TR. Aerospace Medical Research Laboratories.

[3]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[4]  B. Miller,et al.  A Readability Checker with Supervised Learning using Deep Syntactic and Semantic Indicators , 2008 .

[5]  Nick Cramer,et al.  Automatic Keyword Extraction from Individual Documents , 2010 .

[6]  Ryen W. White,et al.  Exploratory Search: Beyond the Query-Response Paradigm , 2009, Exploratory Search: Beyond the Query-Response Paradigm.

[7]  Thomas Hofmann,et al.  Probabilistic latent semantic indexing , 1999, SIGIR '99.

[8]  Oleksandr Frei,et al.  BigARTM: Open Source Library for Regularized Multimodal Topic Modeling of Large Collections , 2015, AIST.

[9]  R. Flesch.  How to test readability , 1951 .

[10]  Felice Dell'Orletta,et al.  Design and Annotation of the First Italian Corpus for Text Simplification , 2015, LAW@NAACL-HLT.

[11]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[12]  Lucia Specia,et al.  Readability Assessment for Text Simplification , 2010 .

[13]  G. Harry McLaughlin,et al.  SMOG Grading - A New Readability Formula. , 1969 .

[14]  R. Gunning.  The Technique of Clear Writing. , 1968 .

[15]  Konstantin Vorontsov,et al.  Additive regularization of topic models , 2015, Machine Learning.

[16]  Lei Liu,et al.  Generating reading orders over document collections , 2015, 2015 IEEE 31st International Conference on Data Engineering.