Section 01
Edit one failure mode
Small edits are easier to evaluate. Change one repeated failure mode, then measure the next batch.
- Avoid rewriting the whole skill after one run.
- Keep the old failure in mind while editing.
- Prefer precise replacement text over extra explanation.
Section 02
Test the revised skill
Run the revised skill against a comparable task so the before and after feedback is meaningful.
- Use a similar workflow.
- Keep the human prompt short.
- Check whether the original failure repeats.
Section 03
Track before and after
The point of feedback is not a perfect score. It is knowing whether a specific change made the skill easier to use.
- Compare rating mix before and after.
- Read the reason text for the same blocker.
- Do not promote the skill until the pattern improves.
Section 05
Keep a release note
A short release note connects feedback to the exact instruction change. That makes future edits easier.
- Name the feedback pattern.
- Name the instruction changed.
- Record the result of the next run.