2024
Enhancing Cross-Modal Fine-Tuning with Gradually Intermediate Modality Generation
ICML 2024poster
Large-scale pretrained models have proven immensely valuable in handling data-intensive modalities like text and image. However, fine-tuning these models for certain specialized modalities, such as protein sequence and cosmic ray, poses challenges due to the significant modality discrepancy and scar…