Hee Seung Hwang

COMPACT: COMPositional Atomic-to-Complex Visual Capability Tuning

Visual instruction tuning (VIT) datasets consist of randomly sampled image-question pairs without regard to the informativeness of each pair. Recent dataset selection methods have shown that a small fraction of such datasets enriched with informative samples can lead to efficient finetuning of Multi…