ICML 2026poster0 citations

ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Training

Dunwei Tu, Hongyan Hao, Hansi Yang, Yihao Chen, Yu Yang, Yueqing Sun, Xingchen Liu, Furao Shen

Abstract

Equipping agents with interactive environments and verifiable tasks for self-exploration is essential for cultivating generalist agents capable of adapting to diverse scenarios. However, high-quality agentic data remain critically scarce, and existing synthesis methods suffer from significant limitations regarding environmental diversity and scalability. To address these challenges, we introduce ScaleEnv, a framework that constructs fully interactive environments and verifiable tasks entirely from scratch. Specifically, ScaleEnv ensures environment reliability through procedural testing, and guarantees task completeness and solvability via tool dependency graph expansion and executable action verification. By enabling agents to learn through exploration within ScaleEnv, we demonstrate significant performance improvements on unseen, multi-turn tool-use benchmarks such as $\tau^2$-Bench and VitaBench, highlighting strong generalization capabilities. Furthermore, we investigate the relationship between environment and task scaling, providing empirical evidence that scaling environmental diversity is critical for robust agent learning.

AgentsTheoryRobustnessGraphsBenchmark
BibTeX
@inproceedings{
tu2026scaleenv,
title={ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Training},
author={Dunwei Tu and Hongyan Hao and Hansi Yang and Yihao Chen and Yu Yang and Yueqing Sun and Xingchen Liu and Furao Shen and Qi GU and Hui Su and Xunliang Cai},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=4GX4r1CYtD}
}