✓ ShippedByAgents
Practitioner (own blog/paper) Refactor / maintenance

Duolingo builds AI STR Fix on the Claude Agent SDK to investigate and fix shake-to-report bugs, including release blockers

Duolingo's DevX AI team found that "Claude, fix this bug" was not enough, so it built AI STR Fix on the Claude Agent SDK (Sonnet for most tasks, Opus for harder ones) to work through the steps engineers already took on Shake-to-Report Jira tickets. The agent finds the relevant code, reconstructs the reporter's activity from pre-filtered tracking events, identifies relevant A/B experiments, finds recent PRs touching the relevant files, writes reproduction steps and suggests an engineer. Each step writes findings to files in a working directory so later agents can build on them. It then implements a fix, with later additions of a self-review step, a Fix CI stage that iterates on failures, a feature research step before implementation to match repo conventions, and automatic beta builds so anyone can verify the fix.

The numbers (as reported)

OutcomeHas fixed release-blocking bugs
Time savedAutomates hours of manual work on each STR bug ticket it runs on
Company sizeNearly 1,000 Duos

Facts

Company / subject
Duolingo
Tools
Claude Agent SDK
Models
Claude Sonnet, Claude Opus
Codebase
brownfield
Work type
Refactor / maintenance
Stack
Jira, iOS, Android
Published
2026-11-04
Last checked
2026-11-12

What the source claims Practitioner (own blog/paper)

Claimed by the builder, writing about their own work. Not checked independently.

  • Has fixed release-blocking bugs
    “AI STR Fix has fixed release-blocking bugs.”
  • Automates hours of manual work per bug ticket Hours of manual work on each STR bug ticket
    “It automates hours of manual work on each STR bug ticket it runs on.”

Caveats

Written by Duolingo's DevX AI team about its own tool. No counts are given for tickets processed, fixes merged, success rate or cost. "Hours of manual work" per ticket is stated without a measured figure. Platforms are implied (Android and iOS experiments) rather than listed as a stack.

More stories by tool: Claude Agent SDK

Related topics: Refactoring and maintenanceBrownfield codebases

Source

Duolingo Blog (Shelby Wengreen)

One email a week: what actually shipped

New sourced stories, the numbers behind them, and what didn't work. No hype.

We'll only use this to send the newsletter. See the privacy page.