✓ ShippedByAgents
Vendor-published Research / benchmark

Microsoft study of its early-2026 Claude Code and Copilot CLI rollout: adopters merged about 24% more pull requests

Updated on Set published to 2026-07-01 from the arXiv submission date on abs/2607.01418.

Microsoft researchers studied tens of thousands of Microsoft engineers during the company's early-2026 rollout of Claude Code and GitHub Copilot CLI. First use spread mainly through social networks, and whether people kept using the tools tracked their coding activity more than their demographics. Using merged pull requests as the output measure, adopters merged about 24% more than a modelled counterfactual, and the lift held across the four-month window. In weeks they used it, Copilot CLI users saw about 2.2 times the lift of Claude Code users.

The numbers (as reported)

PopulationTens of thousands of Microsoft engineers
Merged PR lift+24.0% PRs per engineer per day (95% CI +14.5% to +33.7%)
Lift by tool, any-use weeksCopilot CLI +24.9%, Claude Code +11.4%
WindowFour months after rollout

Facts

Company / subject
Microsoft
Tools
Claude Code, GitHub Copilot
Codebase
Not applicable
Work type
Research / benchmark
Stack
—
Published
2026-07-01
Last checked
2026-11-16
Updated
2026-11-16

What the source claims Vendor-published

Claimed by the vendor that sells the tool. Not checked independently.

  • Adopters merged roughly 24% more pull requests than they would have otherwise +24%
    “adopters merged roughly 24% more pull requests than they would”

Caveats

Written by Microsoft researchers, and Microsoft owns GitHub Copilot, so labelled vendor. The authors note a merged PR is not the same as the value it delivers.

More stories by tool: Claude CodeGitHub Copilot

Related topics: Research and benchmarksVendor case studies

Source

arXiv 2607.01418

One email a week: what actually shipped

New sourced stories, the numbers behind them, and what didn't work. No hype.

We'll only use this to send the newsletter. See the privacy page.