Ten months of GitHub's Copilot coding agent in dotnet/runtime: 878 PRs, 535 merged, with a revert rate no worse than humans'
Stephen Toub reports on the .NET team's use of the Copilot Coding Agent in dotnet/runtime from May 2025 to March 2026, every PR requested by a maintainer. Success climbed from 41.7% in the first month to about 71%; PRs created before the team set up build instructions and firewall rules succeeded 38.1% of the time, 69% after. Cleanup and tests did best, performance work worst. When humans pushed commits to CCA branches the success rate was 86% against 55% without. Across seven repos CCA opened 2,963 PRs and 1,885 merged.
The numbers (as reported)
| CCA PRs in dotnet/runtime | 878; 535 merged, 253 closed, 90 open (67.9% success) |
|---|---|
| Code | Over 95,000 lines added and 31,000 removed |
| Revert rate | 3 of 535 merged (0.6%) vs 0.8% for other PRs |
| Instructions effect | 38.1% success before setup changes, 69% after |
| Seven repos | 2,963 CCA PRs, 1,885 merged (68.6%) |
| Median time to merge | About 2 days |
Facts
- Company / subject
- Microsoft (.NET team)
- Tools
- GitHub Copilot
- Models
- Claude Sonnet 4, Claude Sonnet 4.5
- Codebase
- brownfield
- Work type
- Refactor / maintenance
- Stack
- C#, .NET, C++
- Published
- 2026-03-23
- Last checked
- 2026-11-03
What the source claims Vendor-published
Claimed by the vendor that sells the tool. Not checked independently.
- Success rate rose from 41.7% in the first month to about 71% 41.7% to ~71%
- Good instructions and setup lifted success from 38.1% to 69% 38.1% to 69%
- Revert rate of merged CCA PRs no higher than other PRs 0.6% vs 0.8%
- 20% of issues tackled were over two years old 20%
Caveats
Microsoft owns GitHub, so this is vendor-adjacent, though written by a .NET engineer with detailed data and caveats. CCA tasks were chosen by maintainers, so comparisons with human PRs are between different populations. Compute and CI costs are not analysed. Models named are those used at the time of one experiment.
More stories by tool: GitHub Copilot
Related topics: Refactoring and maintenanceBrownfield codebasesVendor case studies