← Search

Ledell Wu

4 accepted papers

2024

UniTabE: A Universal Pretraining Protocol for Tabular Foundation Model in Data Science

ICLR 2024poster

Recent advancements in Natural Language Processing (NLP) have witnessed the groundbreaking impact of pretrained models, yielding impressive outcomes across various tasks. This study seeks to extend the power of pretraining methodologies to facilitating the prediction over tables in data science, a d…

Cited by 16SourcePDFScholar
2023

AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities

ACL 2023findings

CLIP (Contrastive Language–Image Pretraining) is an English multimodal representation model learned from a massive amount of English text-image pairs and has achieved great success in various downstream tasks, including image classification, text-to-image retrieval, and image generation. When extend…

2023

EVA: Exploring the Limits of Masked Visual Representation Learning at Scale

CVPR 2023highlight

We launch EVA, a vision-centric foundation model to explore the limits of visual representation at scale using only publicly accessible data. EVA is a vanilla ViT pre-trained to reconstruct the masked out image-text aligned vision features conditioned on visible image patches. Via this pretext task,…