2026
The Illusion of Generalization: Instruction-Following, Task Bias and Contamination in Tabular Language Model Evaluation
ICML 2026poster
Tabular Language Models (TLMs) have been claimed to achieve emergent generalization for tabular prediction. We conduct a systematic re-evaluation of Tabula-8B as a representative TLM, utilizing 165 datasets from the UniPredict benchmark. Our investigation reveals three findings. First, binary and ca…