← Search

Shikai Guan

2 accepted papers

2025

On the Out-Of-Distribution Generalization of Large Multimodal Models

CVPR 2025poster

We investigate the generalization boundaries of current Large Multimodal Models (LMMs) via comprehensive evaluation under out-of-distribution scenarios and domain-specific tasks. We evaluate their zero-shot generalization across synthetic images, real-world distributional shifts, and specialized dat…

2025

Understanding the Generalization of In-Context Learning in Transformers: An Empirical Study

ICLR 2025poster

Large language models (LLMs) like GPT-4 and LLaMA-3 utilize the powerful in-context learning (ICL) capability of Transformer architecture to learn on the fly from limited examples. While ICL underpins many LLM applications, its full potential remains hindered by a limited understanding of its genera…