✓ ShippedByAgents
Vendor-published Refactor / maintenance

Ten months of GitHub's Copilot coding agent in dotnet/runtime: 878 PRs, 535 merged, with a revert rate no worse than humans'

Stephen Toub reports on the .NET team's use of the Copilot Coding Agent in dotnet/runtime from May 2025 to March 2026, every PR requested by a maintainer. Success climbed from 41.7% in the first month to about 71%; PRs created before the team set up build instructions and firewall rules succeeded 38.1% of the time, 69% after. Cleanup and tests did best, performance work worst. When humans pushed commits to CCA branches the success rate was 86% against 55% without. Across seven repos CCA opened 2,963 PRs and 1,885 merged.

The numbers (as reported)

CCA PRs in dotnet/runtime878; 535 merged, 253 closed, 90 open (67.9% success)
CodeOver 95,000 lines added and 31,000 removed
Revert rate3 of 535 merged (0.6%) vs 0.8% for other PRs
Instructions effect38.1% success before setup changes, 69% after
Seven repos2,963 CCA PRs, 1,885 merged (68.6%)
Median time to mergeAbout 2 days

Facts

Company / subject
Microsoft (.NET team)
Tools
GitHub Copilot
Models
Claude Sonnet 4, Claude Sonnet 4.5
Codebase
brownfield
Work type
Refactor / maintenance
Stack
C#, .NET, C++
Published
2026-03-23
Last checked
2026-11-03

What the source claims Vendor-published

Claimed by the vendor that sells the tool. Not checked independently.

  • Success rate rose from 41.7% in the first month to about 71% 41.7% to ~71%
  • Good instructions and setup lifted success from 38.1% to 69% 38.1% to 69%
  • Revert rate of merged CCA PRs no higher than other PRs 0.6% vs 0.8%
  • 20% of issues tackled were over two years old 20%

Caveats

Microsoft owns GitHub, so this is vendor-adjacent, though written by a .NET engineer with detailed data and caveats. CCA tasks were chosen by maintainers, so comparisons with human PRs are between different populations. Compute and CI costs are not analysed. Models named are those used at the time of one experiment.

More stories by tool: GitHub Copilot

Related topics: Refactoring and maintenanceBrownfield codebasesVendor case studies

Source

.NET Blog (Stephen Toub)

One email a week: what actually shipped

New sourced stories, the numbers behind them, and what didn't work. No hype.

We'll only use this to send the newsletter. See the privacy page.