← Search

Saurabh Jha

5 accepted papers

2025

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

ICML 2025oral

Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a framework that offers a systematic methodology for benchmarking AI agents to address real-world IT automation tasks. Our…

2025

STRATUS: A Multi-agent System for Autonomous Reliability Engineering of Modern Clouds

NeurIPS 2025poster

In cloud-scale systems, failures are the norm. A distributed computing cluster exhibits hundreds of machine failures and thousands of disk failures; software bugs and misconfigurations are reported to be more frequent. The demand for autonomous, AI-driven reliability engineering continues to grow, a…

Cited by 0SourceScholar
2024

Optimizing IT FinOps and Sustainability through Unsupervised Workload Characterization

AAAI 2024technical

The widespread adoption of public and hybrid clouds, along with elastic resources and various automation tools for dynamic deployment, has accelerated the rapid provisioning of compute resources as needed. Despite these advancements, numerous resources persist unnecessarily due to factors such as po…

Cited by 2SourcePDFScholar
2023

Fault Injection Based Interventional Causal Learning for Distributed Applications

AAAI 2023technical

We apply the machinery of interventional causal learning with programmable interventions to the domain of applications management. Modern applications are modularized into interdependent components or services (e.g. microservices) for ease of development and management. The communication graph among…

2020

Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters

ICML 2020poster

The problem of scheduling of workloads onto heterogeneous processors (e.g., CPUs, GPUs, FPGAs) is of fundamental importance in modern data centers. Current system schedulers rely on application/system-specific heuristics that have to be built on a case-by-case basis. Recent work has demonstrated ML…

Cited by 16SourcePDFScholar