Demystifying Network Foundation Models
Roman Beltiukov, Satyandra Guthula, Wenbo Guo, Walter Willinger, Arpit Gupta
Abstract
This work presents a systematic investigation into the latent knowledge encoded within Network Foundation Models (NFMs). Different from existing efforts, we focus on hidden representations analysis rather than pure downstream task performance and analyze NFMs through a three-part evaluation: Embedding Geometry Analysis to assess representation space utilization, Metric Alignment Assessment to measure correspondence with domain-expert features, and Causal Sensitivity Testing to evaluate robustness to protocol perturbations. Using five diverse network datasets spanning controlled and real-world environments, we evaluate four state-of-the-art NFMs, revealing that they all exhibit significant anisotropy, inconsistent feature sensitivity patterns, an inability to separate the high-level context, payload dependency, and other properties. Our work identifies numerous limitations across all models and demonstrates that addressing them can significantly improve model performance (up to 0.35 increase in $F_1$ scores without architectural changes).
BibTeX
@inproceedings{
beltiukov2025demystifying,
title={Demystifying Network Foundation Models},
author={Roman Beltiukov and Satyandra Guthula and Wenbo Guo and Walter Willinger and Arpit Gupta},
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems Datasets and Benchmarks Track},
year={2025},
url={https://openreview.net/forum?id=S4YDNW5eCx}
}