Srisuma Movva

ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation

We present \textbf{ExCyTIn-Bench}, the first benchmark to \textbf{E}valuate an LLM agent \textbf{X} on the task of \textbf{Cy}ber \textbf{T}hreat \textbf{In}vestigation through security questions derived from investigation graphs. Real‑world security analysts must sift through a large number of hete…