The call
Run a six-week pilot on Team seats, at US$25 a seat a month or US$20 billed annually.
Put two or three teams against a comparison team, with spend limits per member and review standards fixed. Expand only if accepted changes rise while review time, reverts and spend per developer hold.
Buy Claude Code seats beyond the first enthusiasts only on the evidence of a pilot that counts merged work. Self-reports mislead. In METR's 2025 trial, experienced developers believed AI made them 20% faster while it made them 19% slower. This checklist sets up the pilot and the gate for expanding, with a worksheet for the weekly numbers.
When you need this
- Engineers already use Claude Code on personal Pro or Max plans, under consumer data terms.
- Leadership wants a decision on team seats backed by numbers.
- Some teams report large gains and others report none.
Worked example: a three-team pilot's numbers
Seats
Twenty-four engineers across three pilot teams on Team Standard billed annually cost 24 times US$20, or US$480 a month. Moving four heavy users to Premium at US$100 adds US$320 (GILD calculation from Anthropic's pricing).
What to watch
Faros AI measured review time up 91% on high-adoption teams, and Spotify counts its 76% rise in pull requests as 76% more to review. Median review time per pull request is the first number to read each week, and the gate counts merged pull requests and ignores surveys.
The gate
Expand when accepted changes per engineer rose against the comparison team, review time held, reverts and escaped defects stayed flat, and usage-credit spend per member fits the budget.
Pilot plan
Pick the teams
Which teams give a fair comparison?
HowPick two or three teams with working test suites and an established review practice, plus a comparison team on its current tools. Keep review standards unchanged for the whole pilot (GILD decision).
Choose the plan and seats
Which billing route will the pilot run on?
HowTeam seats (Standard US$25 per seat per month, or US$20 billed annually; Premium US$125, or US$100) keep commercial data terms and admin controls. Move pilot engineers off personal plans. On API or cloud-provider billing, Anthropic recommends per-user rate limits by team size, for example 100,000 to 150,000 tokens per minute per user for 5 to 20 users.
Set controls before day one
What can the agent do, and what can it spend?
HowDeploy managed settings with permission rules and a default permission mode, turn on usage credits only with spend limits per member, and give each repository one shared CLAUDE.md. The Claude Code Permissions & Data-Handling Checklist covers the settings.
Connect the measurement
Where will the numbers come from?
HowThe Team and Enterprise analytics dashboard reports lines accepted, suggestion accept rate, and daily active users. With the Claude GitHub app it adds merged pull requests containing Claude Code lines, a public beta Anthropic calls deliberately conservative. OpenTelemetry export streams per-user cost and pull request counts (claude_code.cost.usage, claude_code.pull_request.count) to your own stack.
Run it long enough
When do you read the results?
HowRun it for at least six weeks, with a midpoint review where you adjust scope and leave review standards fixed (GILD decision). Expect rework in the first weeks. Sanity's staff engineer reports that the first attempt at a task is mostly wrong and the third is workable.
Gate the expansion
What result earns more seats?
HowAccepted changes per engineer rose against the comparison team, review time per pull request held, revert and defect rates stayed flat, and spend per active developer fits the budget. Size that budget from Anthropic's enterprise averages of about US$13 per developer per active day and US$150 to US$250 per month.
Measurement worksheet
- Accepted changes: pull requests merged after normal review, per engineer per week, pilot teams against the comparison team.
- Review load: median review time per pull request and the length of the review queue.
- Quality: reverted changes, escaped defects, and rework requested in review on agent-assisted pull requests.
- Spend: usage-credit spend per member from the spend report, or cost per user from OpenTelemetry, against the seat price.
- Adoption: daily active users and sessions from the dashboard, and which engineers stopped using it and why.
Red flags
- Deciding on self-reported speedups alone.
- Pilot engineers on personal Pro or Max accounts, whose data trains models when the setting is on.
- Usage credits turned on without spend limits.
- Review standards relaxed during the pilot to keep up with volume.
Products in this piece
Sources
- Official documentation
- 6
- Public source
- 4
- Claude pricing
- Claude Code docs: Manage costs effectively
- Claude Code docs: Track team usage with analytics
- Claude Code docs: Monitoring
- Claude Code docs: Data usage
- Claude Code docs: Deploy managed settings
- METR: Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (Jul 10, 2025)
- Faros AI: The AI Productivity Paradox Research Report (Jul 23, 2025)
- Spotify Engineering: Coding Is No Longer the Constraint (Jun 3, 2026)
- Sanity: First attempt will be 95% garbage (Vincent Quigley, Sep 2, 2025)