Weekly email and new playbooks for established founders SUBSCRIBE
Apply by 31 December and keep US$1,800 a month for all of 2027. From 1 January it's US$2,200.

← The Schramko Playbooks

Why I Fix Every AI Mistake Twice

When AI gets something wrong, fixing the output fixes it once. So fix it twice. Fix the part that made the mistake, then add a check that catches it if it comes back.

By James Schramko · Updated October 2026

You correct the same mistake three times and start to wonder whether the AI is worth it.

The caption is the wrong size again. The number is rounded again. The phrase you banned last month is back in a draft. Each time you fix the output. Each time the system makes it again, because nothing about the system changed.

I made one decision about what happens after each correction. I treat every correction I make to something the system produced as a fault in the system. I fix the part that made it. I add a check that fails if the mistake ever returns. Then I make the piece again.

This page sits beside the AI Vault Audit, which finds drift across the whole system, and the hardening pass in AI Sovereign Setup. Those find the faults. This is what you do with each one.

The decision

What I stopped doing: patching the output, which meant resizing the caption by hand, retyping the number, or rewording the sentence and moving on.

Why: a patched output teaches the system nothing. The next run starts from the same rule, the same script and the same instruction, and makes the same mistake. You become the quality check, every time. That is what drift usually is. The same unfixed fault turns up on a new piece.

What replaced it: one question every time I correct something. Did the machine make this, or did I choose it?

If the machine made it (a size, a number, a format, a time, a phrase it should never use), it is a machine fault. The fix goes into the rule or the script. A check goes in beside it. Then I make the piece again from the fixed version.

If I chose it (which lines to keep, what order they go in, what the piece is about), it is an editorial call. That stays with me. No check can make it.

What it looks like in numbers

One day in October I made four short videos from one filming session. Along the way I corrected five things the system did:

  • where a cut ended
  • a sliver of caption left on screen
  • a word it misread
  • which platforms a piece went to
  • the wording for each channel

Each one became a fix to the machine with a test behind it, before I rendered or checked the four videos again.

The check on drafts written in my voice has the longer record. A scan runs before any draft reaches me and catches a fixed list of banned phrases. By the time it became a permanent check, it had run 450 times with zero escapes and no false alarms.

How a correction becomes a fix

The order matters.

  1. Name the fault in one line, with the example. "The caption was too big on the vertical version." A vague fault gets a vague fix.
  2. Find where it was made. Maybe a rule was missing. Maybe a rule was wrong. Or the rule was right but sat where the step that broke it never looked. The third kind is the easiest to miss. The instruction exists, just not where the work happens.
  3. Fix it there. Change the rule, the script or the instruction that produced it.
  4. Add the check. Something that fails if the same fault appears again. A check that only warns gets ignored.
  5. Make the piece again from the fixed version. If the new piece is right, the fix worked. A patched piece proves nothing.
  6. Write one line in your log: what you corrected, and what you changed so it cannot happen again.

Drift, and who checks

A person checking every output becomes the system's memory, and the system drifts the moment they look away.

The check runs every time, against a written standard. The person deals only with what fails.

The work runs on a schedule. A check runs after it and logs any failure. I decide the fix, it goes back into the rule, and the next run is right.

When a check is worth adding

Not every rule earns one. A check that blocks good work gets switched off. A switched-off check is worse than none, because you think you are covered.

Add a check when the mistake has happened more than once. Add one sooner when a single slip is costly: something public, something with a client's name on it, money, or access. Keep the check simple and certain. If deciding pass or fail needs judgment, leave it as a written rule and keep the call yourself.

Common mistakes

  • Fixing the piece and promising to remember. You will forget, and the system never knew.
  • Treating an editorial choice as a machine fault. A check cannot pick your best line.
  • Adding checks that warn instead of fail.
  • Writing a new rule when the old one already exists. Look first. Move the old rule to where the work happens before you write a second one.
  • Believing the system's own report that a fault is fixed. Make the piece again and look at it.

The judgment I still make

The system now catches its own repeat mistakes. It does not decide which mistakes matter, or which corrections are machine faults and which are my taste. It does not decide whether a new check will save more time than it costs. Those calls are still mine.

The playbook gives you the method. Mentor is where I become your thinking partner and apply it to your business: I look at what you have, tell you what to do next, and adjust it with you continually. The aim: lift profit, adjust your packages, and win your time back.

APPLY

Related playbooks