2023
Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4
EMNLP 2023long main
In this work, we carry out a data archaeology to infer books that are known to ChatGPT and GPT-4 using a name cloze membership inference query. We find that OpenAI models have memorized a wide collection of copyrighted materials, and that the degree of memorization is tied to the frequency with whic…