✓ ShippedByAgents

← All stories

Practitioner (own blog/paper) Test migration

Google migrates 5,359 test files from JUnit3 to JUnit4 in 3 months with LLMs

Using the same LLM migration toolkit, Google converted old JUnit3 tests and split the results into small changelists for code owners. Review speed was the bottleneck; the team deliberately limited weekly change volume to avoid overwhelming reviewers.

The numbers (as reported)

Files migrated5,359
Lines modified149,000+
Duration3 months
AI-generated code committed unchanged~87%

Facts

Company / subject
Google
Tools
Gemini (fine-tuned, internal toolkit)
Codebase
brownfield
Work type
Test migration
Stack
Java, JUnit
Published
2025-01
Last checked
2026-10-17

Caveats

Experience report; Google uses its own model.

Source

Google experience report (arXiv 2501.06972)

One email a week: what actually shipped

New sourced stories, the numbers behind them, and what didn't work. No hype.