Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learning
Recent time-series foundation models exhibit strong abilities to predict physical systems. These abilities include zero-shot forecasting, in which a model forecasts future states of a system given only a short trajectory as context, without knowledge of the underlying physics. Here, we show that fou…