A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
Large language model (LLM)-driven multi-agent systems (MAS) typically require multiple model invocations and complex coordination during inference, and their execution strategies directly affect system accuracy, latency, and computational cost. Parallel execution provides a means to improve inferenc…