Agent Readiness Reliability Evals Benchmarks

AutomationBench-AA

Independent leaderboard for Zapier's AutomationBench

An independent leaderboard for Zapier's AutomationBench that evaluates whether AI agents can automate simulated SaaS workflows while following business rules.

Screenshot of AutomationBench-AA website

Recent stories

1 linked story

newsPRIMARY2026-07-06

AutomationBench-AA launches SaaS-agent leaderboard with 657 tasks

Artificial Analysis launched an independent Zapier AutomationBench leaderboard with 657 tasks across 40 simulated SaaS apps. Claude Fable 5 and Opus 4.8 led, but models still violated business guardrails.