Metrics framework
Builds on Topic 9.
What you'll produce
A metrics framework for your product: a North Star metric, the key supporting metrics across the funnel, a counter-metric to keep you honest, and the specific metric your PRD feature should move. This proves the Topic 9 skills: choosing the right numbers, avoiding vanity metrics, and defining success.
Instructions
- Pick a North Star metric — the one number that best captures the real value your product delivers (not a vanity metric like "total sign-ups ever"). Define it precisely.
- Map 1–2 supporting metrics per AARRR stage (Acquisition, Activation, Retention, Referral, Revenue) — the inputs that drive the North Star.
- Name one vanity metric your team should not be fooled by, and say why.
- Add a counter-metric — something to watch so you don't "win" your North Star while harming the product (e.g., engagement up but complaints up).
- Tie it to your feature: state the exact metric your Deliverable 3 feature is meant to move, and what result would count as success.
- State your current guess at which funnel stage is weakest for your product, and why.
Worked example
(Product: habit-tracking app)
- North Star: Weekly active users who complete at least one habit check-in (captures real value: people actually building habits).
- Supporting (AARRR): Acquisition — installs from organic search; Activation — % who set up a first habit on day 1; Retention — week-2 retention (the known weak point); Referral — invites sent; Revenue — free→paid conversion.
- Vanity metric to avoid: Total downloads ever — only goes up, hides the week-2 churn.
- Counter-metric: Notification opt-outs — if our reminders boost check-ins but spike opt-outs, we're harming the experience.
- Feature metric: The reminder feature should lift week-2 retention for users who receive it; success = a meaningful, sustained lift vs. control.
- Weakest stage (guess): Retention (week 2) — consistent with discovery.
Rubric
Levels: Needs work (1) / Solid (2) / Excellent (3). Passing = every criterion at Solid or above.
- North Star reflects real value — 1: a vanity/number-go-up metric · 2: a reasonable value metric · 3: a precise, value-capturing North Star.
- Funnel/supporting metrics — 1: random metrics · 2: covers most AARRR stages · 3: clear inputs mapped to stages that drive the North Star.
- Identifies a vanity metric — 1: missing · 2: names one · 3: names one and explains why it misleads.
- Counter-metric — 1: missing · 2: a plausible counter-metric · 3: a counter-metric that genuinely guards the North Star.
- Feature tied to a metric — 1: vague · 2: names the metric · 3: names the metric and a clear success bar.
- Coherence with prior deliverables — 1: disconnected · 2: linked · 3: traces cleanly from discovery/PRD.