Every note in the archive that names Hypothesis Testing: summaries, key takeaways and links to the original essays, episodes and posts. Ask a question below to get a cited answer from just these notes’ authors.
“Every time I speak about hypothesis testing, I get a series of questions about how to run experiments from people working on enterprise products. The assumption behind these questions is that hypothesis testing only works with consumer Internet products. And the assumption behind that belief is that the only way”
Teresa Torres argues that product teams should treat every idea as a testable hypothesis, which requires explaining why a change matters and how much impact it should produce. Ideas from design, sales, and product…
Teresa Torres argues that many teams run A/B tests without first knowing what they are trying to learn, which produces wasted effort and unclear results. Before testing, a team should define a specific hypothesis and…
Teresa Torres argues that product teams routinely build on untested assumptions, treating hopes as facts, and that this risks building something nobody wants. Using an imagined Caltrain commuter app, she shows how to…