Mohamed O Abdelfattah

OSKAR: Omnimodal Self-supervised Knowledge Abstraction and Representation

We present OSKAR, the first multimodal foundation model based on bootstrapped latent feature prediction. Unlike generative or contrastive methods, it avoids memorizing unnecessary details (e.g., pixels), and does not require negative pairs, large memory banks, or hand-crafted augmentations. We propo…