Distribution of Word Frequencies
暂无分享,去创建一个
THE purpose of this communication is to explain, in terms of the theory of information, the implications of the Zipf distribution of word frequencies1. The distribution is formally identical with the Pareto income and Willis taxonomic distributions, but the present discussion is restricted to word frequencies. The discussion resembles that of Mandelbrot2 but is simpler. The discussion by Parker-Rhodes and Joyce3 also resembles Mandelbrot's, but is fallacious.
[1] R. Fisher,et al. The Relation Between the Number of Species and the Number of Individuals in a Random Sample of an Animal Population , 1943 .
[2] A. F. Parker-Rhodes,et al. A Theory of Word-Frequency Distribution , 1956, Nature.
[3] Gustav Herdan,et al. Language as choice and chance , 1957 .