2026
How NOT to benchmark your SITE metric: Beyond Static Leaderboards and Towards Realistic Evaluation.
ICLR 2026poster
Transferability estimation metrics are used to find a high-performing pre-trained model for a given target task without fine-tuning models and without access to the source dataset. Despite the growing interest in developing such metrics, the benchmarks used to measure their progress have gone largel…