Lenny’s Podcast96 min
Ronny Kohavi · Jul 27, 2023
Key learnings- Test every code change, since even small bug fixes or tiny UI tweaks can have surprising, large impact on key metrics.
- Expect most ideas to fail: roughly two-thirds to over 90% of experiments in his experience did not move the target metric, so…
- Allocate a portion of experiments to high-risk, high-reward bets, accepting that about 80% will fail, while keeping most work…
Lenny’s Podcast173 min
Jeff Weinstein · Jul 11, 2024
Key learnings- Treat a customer who takes time to complain as a rare gift; respond quickly and personally, since speed signals that you care.
- Before investing in craft or polish, confirm the product solves a burning problem customers would pause their day for; polish…
- Discount feedback from friends and casual users; focus on the specific target customer who has the problem and would pay to solve…
Lenny’s Podcast131 min
Hamel Husain & Shreya Shankar · Sep 25, 2025
Key learnings- Evals are systematic ways to measure and improve an AI application, essentially data analytics on LLM behavior, replacing…
- Start with error analysis by manually reviewing around 100 sampled traces and writing short notes on the first upstream failure…
- Product people with domain expertise should lead open coding; appoint one 'benevolent dictator' whose judgment you trust instead…
Lenny’s Podcast108 min
Ramesh Johari · Nov 9, 2023
Key learnings- Marketplaces sell the removal of friction (transaction costs) rather than the underlying goods, and both sides are customers who…
- Don't build a marketplace before you have one: early on, find a bespoke value proposition that solves a real problem (e.g…
- Apply a scaled-liquidity smell test: if you don't have a lot of buyers and sellers, you're not yet a marketplace; if one side is…
Lenny’s Podcast91 min
Jess Lachs · Jul 14, 2024
Key learnings- Treat analytics as a business-impact function with a seat at the table, answering 'so what do we do now?' rather than only…
- A central analytics org with pods mapped to partner teams keeps talent bars consistent, creates growth paths, and avoids…
- Carve out intentional time for self-directed deep dives, such as hackathons, because exploratory work is the first thing to slip…
Lenny’s Podcast74 min
Crystal W · Jul 31, 2022
Key learnings- Run Wizard of Oz style experiments before building: use WhatsApp groups, screenshots, or manual processes to validate demand…
- Experiments are worth running even with around 30 users; the trends stay similar, and precision improves with more data, while…
- Define retention concretely as cohort retention; for a free weekly product, expect roughly 60% of the prior week's users to…
Lenny’s Podcast76 min
Kristen Berman · Oct 2, 2022
Key learnings- Pick an uncomfortably specific behavior to change rather than a vague outcome like 'engagement'; teams should align on the exact…
- Map every step required to perform the target behavior (a behavioral diagnosis) and attach the psychological barriers at each…
- Reduce logistical and cognitive barriers to make desired behaviors easier, since people default to the path of least resistance…
Lenny’s Podcast114 min
Austin Hay · Aug 13, 2023
Key learnings- MarTech treats the marketing systems and platforms, both third-party and first-party, as products, and centers on people and…
- A dedicated systems or MarTech owner usually becomes necessary somewhere around 100 to 150 people, when a village approach to…
- Pick tools to solve specific problems, and combine buying a tool for most of the solution with building the remaining custom…
Lenny’s Podcast94 min
Archie Abrams · Nov 7, 2024
Key learnings- Optimize for the absolute number of people reaching each funnel stage, not local conversion rates, since rate-chasing teams often…
- Judge growth by the total long-term value of a merchant cohort (cumulative GMV over several years) rather than per-merchant or…
- Keep long-term holdouts and revisit experiments at 3, 6, 12, and 24 months, because many short-term wins fade and some neutral…
Lenny’s Podcast97 min
Ethan Smith · Sep 14, 2025
Key learnings- Everything that works in traditional SEO also works for AEO, so start with landing pages targeting high-volume keywords before…
- In LLM answers you win by being mentioned across many citations, not by ranking first, so pursue multiple third-party mentions…
- Early-stage companies can win in AEO quickly, since a single citation from a Reddit thread, YouTube video, or blog can get you…
Lenny’s Podcast110 min
Shaun Clowes · Dec 29, 2024
Key learnings- Start every document from the customer, market, and competitor perspective rather than internal execution, since…
- Right-size qualitative research: interview roughly 7 to 14 people, because fewer gives too little signal and more stops yielding…
- Use LLMs to hunt for where your strategy doesn't fit customer feedback, not to confirm what you already believe, and to infer…
Lenny’s Podcast101 min
Jag Duggal · May 16, 2024
Key learnings- Start from a deep, emotionally felt customer pain point rather than a feature idea; Nubank tied its origin to widely hated…
- Use the Sean Ellis survey as a gate before scaling: ask how disappointed users would be if the product disappeared, and raise the…
- Keep small, measure whether customers truly love it, and avoid scaling problems that aren't yet solved; scaling early creates big…
Lenny’s Podcast95 min
Nicole Forsgren · Oct 19, 2025
Key learnings- Before measuring anything, get crisp on the problem or goal, since teams often interpret vague mandates like 'improve developer…
- Shipping smaller changes more often tends to improve both speed and stability together, because small batches have smaller blast…
- DORA's four metrics (deployment frequency, lead time, time to restore, change fail rate) give a benchmark-style view of where you…
Lenny’s Podcast88 min
Itamar Gilad · Sep 21, 2023
Key learnings- Build product from evidence rather than opinion; a leader's conviction should be tested with customer data, interviews, and…
- Define clear, user-facing goals first, and map them with a metrics tree linking a North Star metric (value created for users) to…
- Use ICE (impact, confidence, ease) to score ideas, and be honest about confidence using the confidence meter: opinions and themes…
Lenny’s Podcast107 min
Jonathan Becker · May 7, 2023
Key learnings- Don't put all your marketing budget into one paid channel; treat spend like a portfolio and diversify across channels to avoid…
- Judge paid lead-gen by downstream revenue, not cost per lead; a higher-cost lead that converts to valuable customers can…
- Use a lead scoring model fed by CRM revenue data to bid more on audiences likely to become high-value customers, especially when…
Lenny’s Podcast103 min
Laura Schaffer · Mar 9, 2023
Key learnings- Build career momentum beyond your manager by learning your customers deeply and sharing those insights, which makes you a go-to…
- Share customer insights regularly and make them visible; a recurring voice-of-the-customer report can grow into a forum that…
- Expect many ideas to be rejected; treat each refusal as a chance to bring better information, since leaders value insights they…
Lenny’s Podcast102 min
Dianne Penn · Jul 26, 2026
Key learnings- Treat evals as the new PRDs: turn vague user complaints into concrete, reproducible test sets that researchers can act on and…
- Dig into user transcripts, not just pixels, to find where the model actually failed, such as wrong tool calls, bad retrieval, or…
- Keep strong conviction about a theme or area while staying loose about the specific prototype, and revisit bets across one to two…
Lenny’s Podcast106 min
Hila Qu · Apr 2, 2023
Key learnings- Treat PLG as data-led growth: free products should yield broader reach plus usage data showing which features correlate with…
- Most companies end up running both PLG and sales motions; start PLG early because retrofitting it into a sales-led organization…
- Commit for a year or two and don't mistake simply opening a free trial for a PLG strategy; it requires redesigning activation…
Lenny’s Podcast118 min
Jackson Shuttleworth · Dec 15, 2024
Key learnings- Streaks are an engagement amplifier, not a substitute: first make sure the core product is something users want to return to…
- Choose a unit of use that matches real engagement; simplifying the streak to one lesson kept users, but dumbing it down to one…
- Focus effort on the first seven days, since loss aversion appears to kick in once a streak reaches about seven days and retention…
Lenny’s Podcast98 min
Annie Duke · May 2, 2024
Key learnings- Make implicit judgments explicit (e.g., a hiring rubric) before using intuition; Duke cites Kahneman's work lifting hiring hit…
- Gather opinions independently and asynchronously before meetings, then use the meeting only for discussion, focusing on where…
- Reserve meetings for discussion; discovery of views should happen beforehand and decisions should be made by an accountable…
Lenny’s Podcast126 min
Sean Ellis · Sep 5, 2024
Key learnings- Ask users how they would feel if they could no longer use the product; a high share saying 'very disappointed' is a leading…
- Survey a random sample of users who have actually experienced the product and used it more than once recently, not just sign-ups…
- Use the very-disappointed group as a filter: find their primary benefit and the context ('why is this important to you') to craft…
Lenny’s Podcast76 min
Lauryn Isford · Feb 12, 2023
Key learnings- Experiment when you need to, mainly as risk mitigation for big changes; let customer research and mockups provide conviction for…
- Onboarding is a critical choke point for self-serve products because downstream conversion, deal closing, and team-wide adoption…
- For complex products, an immersive guided wizard that reduces cognitive load can outperform tooltips; tooltips still have a place…
Lenny’s Podcast90 min
Tim Holley · Sep 3, 2023
Key learnings- Make one north-star KPI, such as gross merchandise sales, the drumbeat of every meeting and the yardstick for judging launches.
- Repeat the company narrative relentlessly; Tim suggests people need to hear it several more times than you'd expect before they…
- Benchmark against the broader set of places buyers spend money, not just direct marketplace competitors, to ground prioritization…
Lenny’s Podcast93 min
Dan Hockenmaier · Oct 9, 2022
Key learnings- A growth model is a spreadsheet formula for how your business grows; roughly half its value comes from the act of building it…
- Start with three core building blocks for a SaaS growth model: acquisition channels, retention, and monetization; marketplaces…
- Retention is often the most sensitive lever in a growth model, so small retention gains can be worth more than larger gains…