This page can't load inside an embedded panel.

The panel blocks the storage and requests this page needs. Open it in its own tab instead.

Open in a new tab
  • Benchmarks
    Agent ArenaHow easy is it for AI agents to get started with devtools?AX Tier ListCan an agent sign up on its own?
  • CLI
  • Docs
  • Blog
  • Careers
  • Log inRequest access
Benchmarks

Agent Arena

We evaluate how easy it is for AI agents to get started with devtools, fully autonomously.

Want to improve your rank? Get a detailed report with your insights.

Get report
Browser AutomationSandboxesSearchAI FrameworksDatabases & BaaSAuth & InfraEmail & MessagingLLM ObservabilityImage GenerationVideo Generation
Vercel3m 5s
Netlify3m 46s
Cloudflare Pages4m 50s
Fly.io6m 41s
Railway8m 27s
Render10m 35s
Runs
1Goated: #1 in this categoryVercel3m 5s$1.332111
2Netlify3m 46s$1.352110
3Cloudflare Pages4m 50s$1.83217
4Fly.io6m 41s$2.60218
5Render10m 35s$5.74127
6Railway8m 27s$4.62817
Methodology

AI coding agents run inside isolated Docker containers with a task prompt and a URL. Each agent must autonomously discover docs, install packages, write working code, and verify the result, all without human help beyond providing API credentials when asked.

How rankings work: providers in the same category are ranked against each other on four dimensions: Time, Cost, Errors, and Interruptions. Within a category, the per-dimension rankings combine into an overall position. Less time, lower cost, fewer errors, and fewer interruptions all improve a provider's standing. No composite score, no letter grades.

All results were run with Claude Code on Claude Opus 4.6. Results across more agents and models are coming soon.

All tool calls, errors, timing, and token usage are recorded. Rankings are deterministic from session logs. Multiple independent runs per provider are aggregated.

Don't see your tool?Request an evaluation
Build products agents understand, trust, and choose.
Request access

Benchmarks

  • Agent Arena
  • AX Tier List

Product

  • CLI
  • Docs
  • Log in
  • Book a demo

Company

  • Careers
  • Blog
  • Manifesto

Follow

  • X / Twitter
  • LinkedIn
© 2026 2027 Inc. San Francisco, California. Firegoat AI
PrivacyTermsBack to top