← Search

Diane Bouchacourt

17 accepted papers

2025

$\mathbb{X}$-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs

ICLR 2025poster

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss—an objective matching related samples—underlies methods from self-supervised to multimodal learning. Contrastive losses, however, can be viewed more broadly as modifying a similarity grap…

Cited by 0SourcePDFScholar
2024

Discovering Environments with XRM

ICML 2024oral

Environment annotations are essential for the success of many out-of-distribution (OOD) generalization methods. Unfortunately, these are costly to obtain and often limited by human annotators' biases. To achieve robust generalization, it is essential to develop algorithms for automatic environment d…

2024

Does Progress On Object Recognition Benchmarks Improve Generalization on Crowdsourced, Global Data?

ICLR 2024poster

For more than a decade, researchers have measured progress in object recognition on the ImageNet dataset along with its associated generalization benchmarks such as ImageNet-A, -C, and -R. Recent advances in foundation models, trained on orders of magnitude more data, have begun to saturate performa…

Cited by 3SourcePDFScholar
2024

The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More

NeurIPS 2024poster

Today's best language models still struggle with "hallucinations", factually incorrect generations, which impede their ability to reliably retrieve information seen during training. The *reversal curse*, where models cannot recall information when probed in a different order than was encountered dur…

Cited by 9SourcePDFScholar
2024

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling

NeurIPS 2024poster

Significant research efforts have been made to scale and improve vision-language model (VLM) training approaches. Yet, with an ever-growing number of benchmarks, researchers are tasked with the heavy burden of implementing each protocol, bearing a non-trivial computational cost, and making sense of…

2023

Birth of a Transformer: A Memory Viewpoint

NeurIPS 2023spotlight

Large language models based on transformers have achieved great empirical successes. However, as they are deployed more widely, there is a growing need to better understand their internal mechanisms in order to make them more reliable. These models appear to store vast amounts of knowledge from thei…

Cited by 86SourcePDFScholar
2023

Disentanglement of Correlated Factors via Hausdorff Factorized Support

ICLR 2023poster

A grand goal in deep learning research is to learn representations capable of generalizing across distribution shifts. Disentanglement is one promising direction aimed at aligning a model's representation with the underlying factors generating the data (e.g. color or background). Existing disentangl…

2023

Exploring Why Object Recognition Performance Degrades Across Income Levels and Geographies with Factor Annotations

NeurIPS 2023spotlight

Despite impressive advances in object-recognition, deep learning systems’ performance degrades significantly across geographies and lower income levels---raising pressing concerns of inequity. Addressing such performance gaps remains a challenge, as little is understood about why performance degrade…

Cited by 4SourcePDFScholar
2023

ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotations

ICLR 2023top-25%

Deep learning vision systems are widely deployed across applications where reliability is critical. However, even today's best models can fail to recognize an object when its pose, lighting, or background varies. While existing benchmarks surface examples challenging for models, they do not explain…

Cited by 50SourcePDFScholar
2023

PUG: Photorealistic and Semantically Controllable Synthetic Data for Representation Learning

NeurIPS 2023poster

Synthetic image datasets offer unmatched advantages for designing and evaluating deep neural networks: they make it possible to (i) render as many data samples as needed, (ii) precisely control each scene and yield granular ground truth labels (and captions), (iii) precisely control distribution shi…

2023

Understanding the detrimental class-level effects of data augmentation

NeurIPS 2023poster

Data augmentation (DA) encodes invariance and provides implicit regularization critical to a model's performance in image classification tasks. However, while DA improves average accuracy, recent studies have shown that its impact can be highly class dependent: achieving optimal average accuracy com…

Cited by 13SourcePDFScholar
2021

Grounding inductive biases in natural images: invariance stems from variations in data

NeurIPS 2021poster

To perform well on unseen and potentially out-of-distribution samples, it is desirable for machine learning models to have a predictable response with respect to transformations affecting the factors of variation of the input. Here, we study the relative importance of several types of inductive bias…

2020

A Benchmark for Systematic Generalization in Grounded Language Understanding

NeurIPS 2020poster

Humans easily interpret expressions that describe unfamiliar situations composed from familiar parts ("greet the pink brontosaurus by the ferris wheel"). Modern neural networks, by contrast, struggle to interpret novel compositions. In this paper, we introduce a new benchmark, gSCAN, for evaluating…

2020

Entropy Minimization In Emergent Languages

ICML 2020poster

There is growing interest in studying the languages that emerge when neural agents are jointly trained to solve tasks requiring communication through a discrete channel. We investigate here the information-theoretic complexity of such languages, focusing on the basic two-agent, one-exchange setup. W…

2020

Permutation Equivariant Models for Compositional Generalization in Language

ICLR 2020poster

Humans understand novel sentences by composing meanings and roles of core language components. In contrast, neural network models for natural language modeling fail when such compositional generalization is required. The main contribution of this paper is to hypothesize that language compositionalit…

Cited by 129SourcecodeScholar