Microsoft study of its early-2026 Claude Code and Copilot CLI rollout: adopters merged about 24% more pull requests
Updated on Set published to 2026-07-01 from the arXiv submission date on abs/2607.01418.
Microsoft researchers studied tens of thousands of Microsoft engineers during the company's early-2026 rollout of Claude Code and GitHub Copilot CLI. First use spread mainly through social networks, and whether people kept using the tools tracked their coding activity more than their demographics. Using merged pull requests as the output measure, adopters merged about 24% more than a modelled counterfactual, and the lift held across the four-month window. In weeks they used it, Copilot CLI users saw about 2.2 times the lift of Claude Code users.
The numbers (as reported)
| Population | Tens of thousands of Microsoft engineers |
|---|---|
| Merged PR lift | +24.0% PRs per engineer per day (95% CI +14.5% to +33.7%) |
| Lift by tool, any-use weeks | Copilot CLI +24.9%, Claude Code +11.4% |
| Window | Four months after rollout |
Facts
- Company / subject
- Microsoft
- Tools
- Claude Code, GitHub Copilot
- Codebase
- Not applicable
- Work type
- Research / benchmark
- Stack
- —
- Published
- 2026-07-01
- Last checked
- 2026-11-16
- Updated
- 2026-11-16
What the source claims Vendor-published
Claimed by the vendor that sells the tool. Not checked independently.
- Adopters merged roughly 24% more pull requests than they would have otherwise +24%
“adopters merged roughly 24% more pull requests than they would”
Caveats
Written by Microsoft researchers, and Microsoft owns GitHub Copilot, so labelled vendor. The authors note a merged PR is not the same as the value it delivers.
More stories by tool: Claude CodeGitHub Copilot
Related topics: Research and benchmarksVendor case studies