Nikolay Mikhaylovskiy

Zipf’s and Heaps’ Laws for Tokens and LLM-generated Texts

The frequency distribution of words in human-written texts roughly follows a simple mathematical form known as Zipf’s law. Somewhat less well known is the related Heaps’ law, which describes a sublinear power-law growth of vocabulary size with document size. We study the applicability of Zipf’s and