← Search

Christopher Fifty

4 accepted papers

2025

Restructuring Vector Quantization with the Rotation Trick

ICLR 2025oral

Vector Quantized Variational AutoEncoders (VQ-VAEs) are designed to compress a continuous input to a discrete latent space and reconstruct it with minimal distortion. They operate by maintaining a set of vectors---often referred to as the codebook---and quantizing each encoder output to the nearest…

Cited by 3SourcePDFScholar
2024

Context-Aware Meta-Learning

ICLR 2024poster

Large Language Models like ChatGPT demonstrate a remarkable capacity to learn new concepts during inference without any fine-tuning. However, visual models trained to detect new objects during inference have been unable to replicate this ability, and instead either perform poorly or require meta-tra…

2021

Efficiently Identifying Task Groupings for Multi-Task Learning

NeurIPS 2021spotlight

Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naively training all tasks together in one model often degrades performance, and exhaustively searching through combinations of task groupings can be prohibitively expensiv…

2019

Simplifying Graph Convolutional Networks

ICML 2019oral

Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations. GCNs derive inspiration primarily from recent deep learning approaches, and as a result, may inherit unnecessary complexity and redun…