Sotirios Panagiotis Chytas*

Understanding Multi-compositional learning in Vision and Language models via Category Theory

"Pre-trained large language models (and multi-modal models) offer excellent performance across a wide range of tasks. Despite their effectiveness, we have limited knowledge of their internal knowledge representation. To get started, we use the classic problem of Compositional Zero-Shot Learning (CZS…