← Search

Andrew Nystrom

2 accepted papers

2023

KwikBucks: Correlation Clustering with Cheap-Weak and Expensive-Strong Signals

ICLR 2023poster

The unprecedented rate at which the sizes of machine learning (ML) models are growing necessitates novel approaches to enable efficient and scalable solutions. We contribute to this line of work by studying a novel version of the Budgeted Correlation Clustering problem (\bcc) where along with a limi…

Cited by 20SourcePDFScholar
2022

Deduplicating Training Data Makes Language Models Better

ACL 2022long

We find that existing language modeling datasets contain many near-duplicate examples and long repetitive substrings. As a result, over 1% of the unprompted output of language models trained on these datasets is copied verbatim from the training data. We develop two tools that allow us to deduplicat…