When a feature ships, I want to know whether it made a difference, so the next decision is better rather than simply moving on.
Khi một tính năng vừa phát hành, tôi muốn biết nó có tạo ra khác biệt không, để lần sau quyết định tốt hơn thay vì chỉ chuyển sang việc kế tiếp.
Job context
- Who
- A product manager accountable for outcomes rather than output
- When
- Two to eight weeks after release
- Trigger
- Realising nobody ever revisited last quarter's feature
- Situation
- Shipping is celebrated and outcomes are never revisited
- Constraints
- The team moved to the next thing the following week
5 Pains
Nobody revisits after shipping
HighThe cadence pushes everyone to the next thing immediately.
Root cause: Shipping is an event; outcome is a process
No success threshold was set in advance
HighAfter launch every number can be read favourably.
Root cause: Setting a threshold creates the possibility of provable failure
Too many things change at once to attribute
MediumA marketing campaign runs the same week as the release.
Root cause: Nobody coordinates timing to keep a measurement clean
A bad result is nobody's favourite topic
MediumThe team just spent three months on it, and nobody wants to be the one to say.
Root cause: Naming a bad result means naming a colleague's effort
No way to remove a shipped feature
MediumEven known to be useless, removing it costs more than keeping it.
Root cause: A few users depend on it, and they are the ones who will speak
5 Desired Outcomes
Have a success threshold set before building
FunctionalAttribute the result to the right cause
FunctionalName a bad result without shaming anyone
SocialRemove what does not work
FunctionalTrust the team is improving rather than merely busier
Emotional
5 Existing Solutions
A solution is not the same thing as a product — a customer can hire a behaviour or a workaround too.
A product metrics dashboard
ProductHolds every number and says nothing about which should have moved.
A/B testing
ProductThe cleanest attribution, needing traffic small companies do not have.
Write the success threshold before building
WorkaroundProduct people create their own falsifiability because no process requires it.
A post-release review
BehaviourThe only thing that closes the loop and the first thing dropped when busy.
Ask support whether anyone mentions it
BehaviourThe cheapest measure and surprisingly accurate about whether a feature exists for users at all.
2 Opportunity Gaps
Organisations have rituals for planning and for shipping; the stretch after, where effectiveness becomes knowable, has no rhythm at all.
Why existing solutions fail: Shipping is a dated event so it enters calendars; outcome is an undated process so it enters nobody's.
Potential opportunity: Scheduling the outcome review at the start of building, alongside the release date.
Setting a threshold in advance creates provable failure, and nobody is rewarded for that.
Why existing solutions fail: A vague goal protects everyone in the room while a specific one protects only the truth, so consensus always pulls toward vagueness.
Potential opportunity: Treating a wrong prediction as learning rather than a mark against, and recording both kinds.