Lenny’s Newsletter · Subscriber post · Metrics, data & experimentation · Growth & retention

How to run SEO experiments

And it makes sense — SEO is one of the few remaining “free” growth channels, and still somewhat mysterious

Lenny RachitskyDec 15, 202016 min♥ 17
SourceLenny’s Newsletter
KindSubscriber post
PublishedDec 15, 2020
Readers♥ 17
Originallennysnewsletter.com ↗
N:

Brian Ta, a former SEO lead at Airbnb, Strava, and AngelList, explains how to run SEO experiments on sites with thousands of programmatic pages. He argues SEO tests must be bucketed at the page level rather than the user level, that organic traffic is the only reliable success metric, and that most startups should not build an experimentation framework yet. He walks through a Figma title-tag example and lists traffic and page-count limits.

Subscriber post — summary only

01Key takeaways

  • SEO experiments must bucket at the page level, since Google re-buckets as a new user on every crawl.
  • Organic traffic is the single reliable success metric; rankings, average position, and SERP clicks are too noisy.
  • Most startups should build SEO basics first and skip an experimentation framework until SEO is core and optimizable.
  • Roughly 5,000 daily organic visitors per page type is a practical minimum for running meaningful tests.
  • Title tag and content experiments have driven large traffic gains, such as 15-20% in aggregate at Airbnb.
“Your single source of truth is incoming organic traffic.”Brian Ta · Lenny’s Newsletter
“Content always drives more traffic.”Brian Ta · Lenny’s Newsletter

Summary and takeaways written by PM Atlas; quotes are short excerpts. © the original author.