Even when AI writes the code, expertise still pays: 400,000 Claude Code sessions analyzed
What separates success with AI coding agents is not a coding background but domain expertise. A study Anthropic published on June 16, 2026 analyzed about 400,000 Claude Code sessions (235,000 users) and found that expert sessions reach a verified success rate of 28-33%, double the 15% of novices. Experts also drew 12 actions per prompt, more than double the novices' 5. ASAP summarizes the result from the primary source.
What it found
The key point is that domain expertise, not coding background, separates outcomes. The more domain expertise a person brings to a session, the more work Claude does per instruction. So even as AI takes over execution, knowing what to ask and how still makes the difference.
The expertise gap in numbers
Success and output are sharply divided by expertise level in the 2026 data. The figures published on June 16, 2026 are as follows.
| Metric | Novice | Expert |
|---|---|---|
| Verified success rate | 15% | 28-33% |
| Actions per prompt | 5 | 12 |
Experts drew more than double the actions from a single prompt and reached verified success at roughly twice the rate of novices.
Anyone produces code — occupation barely matters
Occupation is almost irrelevant in code-producing sessions, per the 2026 analysis. Most major occupations reached nearly the same success rate as software engineers in code-producing sessions, at 34% versus 29% on average, with non-engineering roles slightly ahead. This supports the core finding that expertise matters more than a coding history.
What changed over seven months
Usage patterns are also shifting, with clear changes over the seven months from October 2025. Between October 2025 and April 2026, the share of debugging sessions fell by nearly half, and the average task value per session rose about 25%. People moved from simple bug-fixing toward handing more valuable work to AI.
What it means
The 2026 study is evidence that as execution gets cheap, expertise and judgment become the differentiator. Even when AI writes the code, the domain expertise to define what to build and verify the result does not vanish; it is rewarded more. Field expertise, more than a coding history, becomes the core asset in using AI.
Wrap-up
Expertise is not devalued in the AI era. Anthropic's 400,000-session analysis shows in numbers that domain expertise is the key variable separating Claude Code outcomes, and that expertise, not occupation, decides success. The more execution you hand to AI, the more valuable the person who knows the direction becomes.
Source: Anthropic, "Agentic coding and persistent returns to expertise" (2026-06-16; ~400,000 sessions, 235,000 users; analysis from October 2025 to April 2026).
AI & tech,
delivered fastest
Beyond the headlines — into the context and the structure
Ai Soon As Possible · asapai.co.kr
