All case studies
Case study 01 · AI agents$ cat work/ai-doc-agent.md

An AI agent that fixes documentation errors

Role
Product owner
When
2026 to present
With
Engineering, applied science, content owners, support
Status
Piloted, expanding to more services
~15Kbacklog in scope

01The problem

Customers report roughly 1,100 documentation errors a month. Each report goes to a writer, who has to reproduce it, find the source file, write the change, and get it reviewed.

By 2026 about 15,000 reports were open. The writing teams were never going to close that by hand, and every open report is a customer who found something wrong.

02The bet

  • An agent that triages each report, writes the documentation change, and opens a code review for the page owner.
  • A person approves every change. The agent answers review comments and closes the report after the change merges.
  • Start small. The pilot ran one service team's entire backlog, just under 200 reports, before we opened it up to other services.
  • Agree early on which kinds of changes the agent may correct by itself and which always need a reviewer.

03How I measured it

  • The main metric is the share of customer reports the agent fully resolves. Drafted changes don't count toward it.
  • I moved the definition of resolved from merged to live on the site. A merged change that customers can't see yet hasn't helped anyone.
  • A dashboard tracks volume, approvals, and output, so service teams can see how the agent is doing without asking.

04The result

  • The agent was code complete and the pilot launched in August 2026. Readiness work for the cross-service rollout followed.
  • Next up: send new reports to the agent by default, and show open fixes in the tool owners already use so they can review them there.
Contact

Let's talk shop.

I'm open to product roles, and happy to compare notes on AI products or developer docs. Email is the quickest way to reach me.