ITSMBench
Enterprise-agent evaluation benchmark for IT service management
An open-source benchmark and executable environment for evaluating enterprise agents on IT service-management workflows, with persistent state, simulated users, tool use, and deterministic grading.
Recent stories
2 linked stories
workflowSECONDARY2026-08-03
Agent studies trace reliability failures to harness design and verifier quality
A Renmin survey, Cline's SDK notes, and AutomationBench trajectory reviews point beyond context windows to harness design and verifier quality. A failure-mode paper maps issues across models, memory, tools, users, and environment.
releasePRIMARY2026-07-29
Enterprise Worlds opens ITSMBench with 93 tools for enterprise agent evals
Enterprise Worlds opened ITSMBench for executable enterprise-agent tasks with persistent state, simulated users, 93 tools, and deterministic grading. The benchmark starts with IT service-management workflows.