Drawer 11 · 316 notes · 58 people · 2005–2026

Metrics, data & experimentation

North-star metrics, analytics, A/B tests, and data-informed decisions

Q:
Answers from Metrics, data & experimentation notes, cited
@ttorres · Teresa Torres on X♥ 9
💭 "I wish I could click on this card and be like, 'Clean this up.'" When a customer pointed out a flat, unstructured branch in her AI-generated opportunity solution tree, it sparked a three-week journey to fix the problem at its source. Here's what you'll learn from this article: How one customer…
Product Talk · Teresa TorresAug 19, 2013

Why You Only See What You Want to See

Aug 19, 2013 · 4 min

Teresa Torres argues that product teams often fall for confirmation bias: people notice evidence that supports their ideas and overlook disconfirming signals, even when given the same data. Her example shows how…

Lenny’s Podcast88 min

Gibson Biddle on his DHM product strategy framework, GEM roadmap prioritization framework, 5 Netflix strategy mini case studies, building a personal board of directors, and much more

Gibson Biddle · Jun 20, 2022
Key learnings
  • Frame product strategy as a set of testable hypotheses about how to delight customers in hard-to-copy, margin-enhancing ways, and…
  • Use A/B tests to check what customers say they want; Gibson's new-release test showed that faster delivery barely moved…
  • Estimate the value of a feature by multiplying affected customers by lifetime value and a word-of-mouth factor, then weigh it…
Product Talk · Teresa TorresAug 22, 2013

Turn Your Inside View Outward

Aug 22, 2013 · 3 min

Teresa Torres examines the common push to build a mobile app and tests the assumption that it will drive growth. Stakeholders often justify the idea with broad beliefs about mobile usage, yet the data on typical app…

Lenny’s Podcast159 min

Rethinking SEO in the age of AI

Eli Schwartz · Sep 19, 2024
Key learnings
  • Treat SEO as a product: start by understanding the user's search journey and what they would actually type before investing…
  • Skip SEO if you can't name the specific searches your target user would make; many SaaS products lack a real search journey and…
  • Expect AI answers to absorb top-of-funnel discovery queries, and focus SEO effort on mid-funnel, intent-rich queries where users…
Lenny’s Newsletter♥ 13

Prioritizing conversion opportunities

May 26, 2020 · 6 min
Subscriber post — summary only

Lenny answers a reader question on how to split effort across conversion levers (focus, motivation, friction) and which tends to pay off most. He shares rules of thumb such as starting wide, mining past wins, and mixing…

Lenny’s Newsletter♥ 227

What is good free-to-paid conversion

Aug 1, 2023 · 13 min
Subscriber post — summary only

Lenny Rachitsky, with OpenView and Pendo, benchmarks free-to-paid conversion from a survey of 1,000+ products, defining good and great rates for freemium, sales-assisted, and free-trial models. It argues conversion…

Lenny’s Podcast108 min

Tobi Lutke

Tobi Lutke · Feb 2, 2025
Key learnings
  • Start new product decisions from first principles by re-deriving them from today's building blocks instead of copying what…
  • Be suspicious of pitches to build a better version of what everyone already does; doing the same thing cannot yield something…
  • Stay close to the details of the work, including the underlying technology, so decisions rest on real understanding rather than…