Duolingo builds AI STR Fix on the Claude Agent SDK to investigate and fix shake-to-report bugs, including release blockers
Duolingo's DevX AI team found that "Claude, fix this bug" was not enough, so it built AI STR Fix on the Claude Agent SDK (Sonnet for most tasks, Opus for harder ones) to work through the steps engineers already took on Shake-to-Report Jira tickets. The agent finds the relevant code, reconstructs the reporter's activity from pre-filtered tracking events, identifies relevant A/B experiments, finds recent PRs touching the relevant files, writes reproduction steps and suggests an engineer. Each step writes findings to files in a working directory so later agents can build on them. It then implements a fix, with later additions of a self-review step, a Fix CI stage that iterates on failures, a feature research step before implementation to match repo conventions, and automatic beta builds so anyone can verify the fix.
The numbers (as reported)
| Outcome | Has fixed release-blocking bugs |
|---|---|
| Time saved | Automates hours of manual work on each STR bug ticket it runs on |
| Company size | Nearly 1,000 Duos |
Facts
- Company / subject
- Duolingo
- Tools
- Claude Agent SDK
- Models
- Claude Sonnet, Claude Opus
- Codebase
- brownfield
- Work type
- Refactor / maintenance
- Stack
- Jira, iOS, Android
- Published
- 2026-11-04
- Last checked
- 2026-11-12
What the source claims Practitioner (own blog/paper)
Claimed by the builder, writing about their own work. Not checked independently.
- Has fixed release-blocking bugs
“AI STR Fix has fixed release-blocking bugs.”
- Automates hours of manual work per bug ticket Hours of manual work on each STR bug ticket
“It automates hours of manual work on each STR bug ticket it runs on.”
Caveats
Written by Duolingo's DevX AI team about its own tool. No counts are given for tickets processed, fixes merged, success rate or cost. "Hours of manual work" per ticket is stated without a measured figure. Platforms are implied (Android and iOS experiments) rather than listed as a stack.
More stories by tool: Claude Agent SDK
Related topics: Refactoring and maintenanceBrownfield codebases