Framework · 1 note · discussed by Crystal W

Wizard of Oz Testing

Every note in the archive that names Wizard of Oz Testing: summaries, key takeaways and links to the original essays, episodes and posts. Ask a question below to get a cited answer from just these notes’ authors.

Q:
Answers quote and cite the source notes
Lenny’s Podcast74 min

How to scrappily hire for, measure, and unlock growth

Crystal W · Jul 31, 2022
Key learnings
  • Run Wizard of Oz style experiments before building: use WhatsApp groups, screenshots, or manual processes to validate demand…
  • Experiments are worth running even with around 30 users; the trends stay similar, and precision improves with more data, while…
  • Define retention concretely as cohort retention; for a free weekly product, expect roughly 60% of the prior week's users to…