Drawer 11 · 316 notes · 58 people · 2005–2026

Metrics, data & experimentation

North-star metrics, analytics, A/B tests, and data-informed decisions

Q:
Answers from Metrics, data & experimentation notes, cited
Lenny’s Newsletter♥ 13

Prioritizing conversion opportunities

May 26, 2020 · 6 min
Subscriber post — summary only

Lenny answers a reader question on how to split effort across conversion levers (focus, motivation, friction) and which tends to pay off most. He shares rules of thumb such as starting wide, mining past wins, and mixing…

Lenny’s Newsletter♥ 227

What is good free-to-paid conversion

Aug 1, 2023 · 13 min
Subscriber post — summary only

Lenny Rachitsky, with OpenView and Pendo, benchmarks free-to-paid conversion from a survey of 1,000+ products, defining good and great rates for freemium, sales-assisted, and free-trial models. It argues conversion…

Product Talk · Teresa TorresJan 7, 2015

Run Experiments Before You Write Code

Jan 7, 2015 · 5 min

Teresa Torres argues that the Lean Startup loop of Build, Measure, Learn starts in the wrong place, and that teams should instead Learn, Build, Measure. Building first means writing code for features that often fail…

Product Talk · Teresa TorresNov 11, 2015

How to Choose Your Next Experiments

Nov 11, 2015

Teresa Torres argues that a common mistake among teams new to Lean Startup methods is substituting experimentation for judgment, testing options like folders versus tags without first reasoning about which is most…

Product Talk · Teresa TorresSep 23, 2015

The Path to Better Product Decisions

Sep 23, 2015 · 5 min

Teresa Torres argues that product managers often fall into a throughput mindset, filling backlogs and keeping engineers busy rather than driving outcomes. She identifies three recurring failures: not starting from a…

Lenny’s Newsletter♥ 89

Prioritizing

Jul 27, 2021 · 8 min
Subscriber post — summary only

Lenny argues that most teams should skip elaborate prioritization frameworks and use a simple impact-versus-cost sort of T-shirt-sized ideas, then refine it with team input. He stresses that the roadmap must follow a…

SVPG · Marty CaganOct 1, 2007

Prototype Testing

Oct 1, 2007 · 16 min

Marty Cagan argues that testing high-fidelity prototypes with real users is the most important activity a product manager performs, because it reveals whether people can use a product and whether they want it before…

Product Talk · Teresa TorresJan 30, 2014

Are You Getting Your Growth Goals Right?

Jan 30, 2014 · 4 min

Teresa Torres argues that once a product's success funnel converts well, the next step is growth, but only after that funnel is healthy; otherwise acquiring users just wastes time, energy and money. She introduces two…

Product Talk · Teresa TorresAug 8, 2013

How To Make Better Product Decisions

Aug 8, 2013 · 3 min

Teresa Torres argues that product managers make dozens of decisions daily and tend to feel confident about them, yet decision research shows people often make poor choices while believing they are sound. Our minds are…

Product Talk · Teresa TorresFeb 8, 2017

The Evolution of Modern Product Discovery

Feb 8, 2017 · 30 min

Teresa Torres traces how product discovery has evolved over roughly two decades, from long requirements documents and shipping flops like Windows ME toward experiment-driven, customer-centered practice. She argues that…

Product Talk · Teresa TorresMar 23, 2016

An Introduction to Product Discovery

Mar 23, 2016 · 3 min

Teresa Torres argues that many product managers remain unaware of a fundamental shift toward modern product discovery, despite the Lean Startup and design thinking having been around for years. She observes that many…

SVPG · Marty CaganFeb 28, 2011

Why Traditional Messaging Fails

Feb 28, 2011 · 4 min

Cagan argues that the old model of carefully controlled, consistent product messaging no longer works, because most people first hear about a product from others outside the company's control. Messaging must now engage…

SVPG · Marty CaganJan 15, 2019

More PM Problem Areas

Jan 15, 2019 · 5 min

Marty Cagan follows up on an earlier list of product manager problem areas with five more common pitfalls. He argues that many teams play defense, acting risk-averse and protecting ground instead of moving forward…