Lenny’s Newsletter · Subscriber post · Metrics, data & experimentation · Org design & culture

Fostering a culture of experimentation

Each week I tackle reader questions about product, growth, working with humans, and anything else that’s stressing you out at the office

Lenny RachitskySep 22, 202011 min♥ 26
SourceLenny’s Newsletter
KindSubscriber post
PublishedSep 22, 2020
Readers♥ 26
Originallennysnewsletter.com ↗
N:

Lenny answers a reader question by unpacking how Airbnb built a strong experimentation culture, using its early data science hires, north-star metric, embedded data scientists, and trustworthy tooling as the core story. The post argues that treating data as a voice of customers, and investing in reliable experimentation infrastructure, lets teams move from opinion-based to fact-based decisions.

Subscriber post — summary only

01Key takeaways

  • Hire a data-focused person early, since early data relationships build trust and justify later investment in data
  • Anchor the company on one measurable north-star metric so experiments can be compared and prioritized
  • Embed dedicated data scientists in product teams, but centralize processes and tooling to keep trust consistent
  • Frame data as the voice of customers at scale to shift discussions from opinions to facts
  • Build simple experimentation tooling first, evolve it over time, and ensure teams trust the results
“Data is what allows you to hear from your community at scale.”Riley Newman · Lenny’s Newsletter
“Part of a data-driven culture is the humility about not knowing the right answer.”Rebecca Rosenfelt · Lenny’s Newsletter

02Frameworks mentioned

Summary and takeaways written by PM Atlas; quotes are short excerpts. © the original author.