Lucas Charpentier — accepted AI-conference papers

2024

Compositional Generalization with Grounded Language Models

Sondre Wold, Étienne Simon, Lucas Charpentier, Egor Kostylev, Erik Velldal, Lilja Øvrelid

ACL 2024findings

Grounded language models use external sources of information, such as knowledge graphs, to meet some of the general challenges associated with pre-training. By extending previous work on compositional generalization in semantic parsing, we allow for a controlled evaluation of the degree to which the…

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2024

More room for language: Investigating the effect of retrieval on language models

David Samuel, Lucas Charpentier, Sondre Wold

NAACL 2024short

Retrieval-augmented language models pose a promising alternative to standard language modeling. During pretraining, these models search in a corpus of documents for contextually relevant information that could aid the language modeling objective. We introduce an ‘ideal retrieval’ methodology to stud…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗