When I plan to use machine output in real work, I want to know where it tends to be wrong, so I do not send a customer something polished and incorrect.
Khi tôi định dùng kết quả máy sinh ra trong việc thật, tôi muốn biết chỗ nào nó hay sai, để không gửi cho khách một thứ trông chỉn chu mà sai.
Job context
- Who
- The person who takes the output straight to a customer
- When
- Right before sending
- Trigger
- Catching an invented number inside a perfectly fluent paragraph
- Situation
- A wrong answer does not look like an error; it looks like an answer
- Constraints
- No time to verify line by line, and the checker is not an expert
5 Pains
Does not know where to check
HighThe whole text reads uniformly, so nothing raises its hand to be checked.
Root cause: The confidence of the text does not track its correctness
Careful checking erases the time saved
HighRe-reading everything often takes longer than writing it.
Root cause: Checking is organised as a full read rather than a targeted probe
The checker lacks the expertise to catch it
HighHanding the check to the least experienced person is the commonest arrangement.
Root cause: Checking is treated as low-status work and given to whoever is free
One error discredits the whole process
MediumOne error reaching a customer sends the whole company back to manual.
Root cause: Nobody set an acceptable error rate in advance
Cannot trace where the error came from
MediumThere is no path back from a wrong sentence to its source.
Root cause: The output carries no trace of its inputs
5 Desired Outcomes
Know which part of the output needs scrutiny
FunctionalFinish checking in minutes rather than re-reading everything
FunctionalA non-expert can still check it
FunctionalHave an acceptable error rate agreed in advance
FunctionalSend it without dread
Emotional
5 Existing Solutions
A solution is not the same thing as a product — a customer can hire a behaviour or a workaround too.
A human reads everything before sending
BehaviourThe one common method, and the one that erases the saving.
Source-citation tooling
ProductSolves the traceability problem, and exists in only a fraction of tools.
Use it only for drafts, never for what is sent
WorkaroundA safety boundary users draw themselves because nobody draws it for them.
Ask the same question twice and compare
WorkaroundThe trade's folk test — cheap, and it catches exactly the fabrication class.
An internal AI usage policy
ServiceStates what is forbidden; says nothing about how to check what is allowed.
2 Opportunity Gaps
Fluency has nothing to do with correctness, yet people read them as the same signal.
Why existing solutions fail: Tools are judged on how smoothly the output reads, which is precisely what removes the reader's ability to spot the doubtful part.
Potential opportunity: Output that flags where it is least certain, instead of delivering every sentence in one voice.
Checking is handed to the least expert person because it is treated as low-status work.
Why existing solutions fail: Catching a subtle error takes more expertise than doing the work, an inversion no workflow accounts for.
Potential opportunity: Turning checking from judgement into comparison against sources, which a non-expert can do.