David Castellano Falcón

Think Big, Teach Small: Do Language Models Distil Occam’s Razor?

Large language models have recently shown a remarkable ability for few-shot learning, including patterns of algorithmic nature. However, it is still an open question to determine what kind of patterns these models can capture and how many examples they need in their prompts. We frame this question a…