← Search

Leon Weber

4 accepted papers

2022

BigBio: A Framework for Data-Centric Biomedical Natural Language Processing

NeurIPS 2022accept

Training and evaluating language models increasingly requires the construction of meta-datasets -- diverse collections of curated data with clear provenance. Natural language prompting has recently lead to improved zero-shot generalization by transforming existing, supervised datasets into a variety…

2022

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

NeurIPS 2022accept

As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop, a 1-year international and multidisciplinary initiative, was formed with the goal of researching and training large lan…

Cited by 214SourcePDFScholar
2021

Extend, don’t rebuild: Phrasing conditional graph modification as autoregressive sequence labelling

EMNLP 2021main

Deriving and modifying graphs from natural language text has become a versatile basis technology for information extraction with applications in many subfields, such as semantic parsing or knowledge graph construction. A recent work used this technique for modifying scene graphs (He et al. 2020), by…