Drawer 05 · 298 notes · 90 people · 2014–2026

Building AI products

AI-native products, evals, agents, and how AI changes product work

Q:
Answers from Building AI products notes, cited
Lenny’s Podcast110 min

Why companies are becoming a series of loops

Anish Acharya · Sep 6, 2026
Key learnings
  • Treat each business function as an agent loop: map its inputs, outputs, and the points where it gets blocked, then supply…
  • Expect loops to climb local maxima quickly, but plan for humans to supply out-of-distribution intuition that moves you to the…
  • When an agent gets stuck, have a human coach it through the problem; the captured traces let the agent handle that case next time.
Lenny’s Podcast84 min

Adam Mosseri: AI is a tailwind for authenticity

Adam Mosseri · Jul 9, 2026
Key learnings
  • Small pods of four to six generalist engineers plus a generalist 'product staff' role can move faster than large specialist…
  • As building gets cheaper, spend more time deciding what to build; taste and judgment about strategy become the scarce skills, per…
  • Keep investing in tomorrow's senior talent in each function, not just today's, or the organization will regret it in a few years.
Lenny’s Podcast87 min

Benjamin Mann

Benjamin Mann · Jul 20, 2025
Key learnings
  • Mann argues progress is accelerating, not plateauing: model releases now come every one to three months, and scaling laws…
  • Define transformative AI by the Economic Turing Test: if an agent passes as a human hire for a role over a month or three, track…
  • Use AI tools ambitiously and persistently; Mann says retrying a task from a fresh start succeeds far more often than repeatedly…
Lenny’s Podcast81 min

OpenAI researcher on why soft skills are the future of work

Karina Nguyen · Feb 9, 2025
Key learnings
  • Build rigorous evals first: define deterministic pass/fail behaviors (e.g., correct time handling) and human win-rate comparisons…
  • Use prompting as a fast prototyping method to test product ideas before engineering investment, as Karina did with file uploads…
  • Synthetic data scales cheaply for teaching core product behaviors, but human expert data is still needed for specialized…
Lenny’s Podcast129 min

Building the most AI-pilled engineering team in the world

Fiona Fung · Jun 21, 2026
Key learnings
  • Manage with AI by running recurring Claude sessions over repos, Slack, and metrics to summarize shipped work and turn it into…
  • Automate daily leadership rituals such as scanning feedback channels with scheduled routines that surface themes and draft PRs…
  • Give Claude explicit frameworks such as checked-in specs and skills describing what good looks like, so automated code review can…
Lenny’s Podcast88 min

Why LinkedIn is turning PMs into AI-powered "full stack builders”

Tomer Cohen · Dec 4, 2025
Key learnings
  • Prioritize clarity over being right: align the team on the problem and direction even if the bet might be wrong, since confusion…
  • Test whether a disagreement is real or just a misunderstanding by asking people to restate your point in their own words before…
  • Make sure stated priorities match resourcing; if your top initiative lacks your best engineers, the priority is not real.
Lenny’s Podcast66 min

The role of AI in product development

Ryan J. Salva · Sep 4, 2022
Key learnings
  • Ring-fence a dedicated R&D team for long-horizon, uncertain bets, reserving roughly 5-10% of capacity for audacious experiments…
  • Hand off research prototypes only after customer signal exists, and move researchers back to R&D based on a trained replacement…
  • Let the team that owns the product day to day control its own roadmap; don't outsource innovation entirely to an R&D group.
Lenny’s Podcast91 min

Inside OpenAI

Logan Kilpatrick · Feb 8, 2024
Key learnings
  • Products built on general-purpose AI should either be radically better than ChatGPT in specific ways or focus on a narrow…
  • Give models rich context about who you are, your goals, and your audience; Logan argues context is the main lever for getting…
  • Treat prompt engineering like briefing a capable human with no background: explain the situation, the audience, and what good…
Lenny’s Podcast93 min

OpenAI Codex lead on the new shape of product work

Andrew Ambrosino · Jun 28, 2026
Key learnings
  • Implementation is no longer the expensive part of building; the scarce skill is taste, meaning deciding what to build and…
  • Pick the medium deliberately: use a document to clarify a vague product area, and a prototype to stress-test an interaction…
  • Prototypes can look production-ready and anchor teams too early, so label whether something is an exploration or a shipping…
Lenny’s Podcast110 min

First interview with Scale AI’s CEO: $14B Meta deal, what’s working in enterprise AI, and what frontier labs are building next

Jason Droege · Oct 9, 2025
Key learnings
  • Model improvement now relies heavily on experts (80% of Scale's expert network holds a bachelor's or higher) defining what good…
  • Enterprise AI pilots that reach 60-70% accuracy feel close, but robust automation of important processes often takes 6-12 months…
  • Validate a new business by checking whether it can sustain high gross margins and whether competitors can match the economics in…
Lenny’s Podcast159 min

Rethinking SEO in the age of AI

Eli Schwartz · Sep 19, 2024
Key learnings
  • Treat SEO as a product: start by understanding the user's search journey and what they would actually type before investing…
  • Skip SEO if you can't name the specific searches your target user would make; many SaaS products lack a real search journey and…
  • Expect AI answers to absorb top-of-funnel discovery queries, and focus SEO effort on mid-funnel, intent-rich queries where users…
Lenny’s Podcast76 min

Lessons on building product sense, navigating AI, optimizing the first mile, and making it through the messy middle

Scott Belsky · May 18, 2023
Key learnings
  • Build product sense by developing genuine empathy for the customer's problem before getting attached to a particular solution…
  • Optimize the first mile of the experience: users arrive lazy, selfish, and impatient, so onboarding, orientation, and defaults…
  • Re-examine onboarding for each new customer cohort, since later pragmatist users are less forgiving and need a reimagined…
Lenny’s Podcast111 min

I’ve run 75+ businesses. Here’s why you’re probably chasing the wrong idea.

Andrew Wilkinson · Jul 3, 2025
Key learnings
  • Choose a business in an area you're genuinely interested in, but look for the unglamorous niche where competition is low…
  • Pick a first business that delivers a quick, simple win, since early success builds the confidence and narrative needed to keep…
  • Look for a unique edge (skills, background, or access to audiences) and pivot toward the most profitable customer segment for…
Lenny’s Podcast53 min

Product lessons from Waymo

Shweta Shriva · Apr 9, 2023
Key learnings
  • Build autonomous driving to feel natural and predictable, using human driving data while discarding bad driving behavior, so…
  • Expect the MVP bar to be far higher when safety is at stake, but still ship early and iterate on real-world deployment.
  • Track both commercial/operational metrics (trips, active users, cost) and system behavior metrics (safety versus human…
Lenny’s Podcast78 min

OpenAI’s Head of Design: This is the best time in history to be a designer

Ian Silber · Aug 16, 2026
Key learnings
  • Designers are still early in adapting to AI; nobody has a settled design process, so starting to experiment today already gives…
  • Design work has not sped up as much as engineering because the process still requires messy iteration, trying and discarding…
  • Use AI tools across the whole design process, including dropping early ideas into a coding or agent tool to prototype and think…
Lenny’s Podcast117 min

The power user’s guide to Codex: parallelizing workflows, planning techniques, advanced context engineering tips, automating code reviews, and more

Alexander Embiricos · Jan 12, 2026
Key learnings
  • Ship a product to a small group first, then learn empirically from usage rather than over-planning, especially in fast-moving AI…
  • Onboard users into agentic tools by first working alongside them in the local IDE or terminal, then gradually configure…
  • Give AI coding tools your hardest real tasks rather than trivial ones, and build trust by having the agent first understand the…
Lenny’s Podcast117 min

Elena Verna 4.0

Elena Verna 4.0 · Dec 18, 2025
Key learnings
  • Expect most of your classic growth playbook to transfer poorly in fast-moving AI categories; Elena estimates only 30-40% of her…
  • Build in public: pair regular product shipping with founder-led and employee social posts so the market sees constant change and…
  • Give the product away generously, including credits for hackathons and events, since removing the barrier to trying an AI product…
Lenny’s Podcast131 min

How Devin replaces your junior engineers with infinite AI interns that never sleep

Scott Wu · Sep 8, 2025
Key learnings
  • Treat an AI agent like a junior engineer: scope it with well-defined tasks rather than open-ended problems, and start with small…
  • Run several agents asynchronously in parallel and only step in for the portions needing human judgment, such as scoping…
  • Invest up front in setup for the agent: connect repositories, teach it how to run lint and CI, and give it a virtual machine so…
Lenny’s Podcast131 min

Boris Cherny

Boris Cherny · Feb 19, 2026
Key learnings
  • Ship with minimal scaffolding and let the model choose tools and order of operations, rather than boxing it into rigid workflows…
  • Watch how people hack your product for purposes it wasn't designed for; that latent demand, like data scientists using a terminal…
  • Bet on the more general model over time instead of fine-tuning or tiny models, since scaffolding gains of 10-20% often vanish…
Lenny’s Podcast108 min

Bending the universe in your favor

Claire Vo · Apr 7, 2024
Key learnings
  • Know what you want from your career and your next role, and ask for it clearly, framed around how the role solves a real problem…
  • Time promotion conversations to the company's talent calendar and pitch concrete org-level gaps you can fill, such as an org…
  • Lean into your zone of genius by auditing your calendar, grouping activities by energy, and deliberately protecting time for the…
Lenny’s Podcast104 min

Brian Balfour: 10 lessons on career, growth, and life

Brian Balfour · Oct 5, 2023
Key learnings
  • Building a great product is necessary but not sufficient; durable winners separate themselves by building strong distribution…
  • New distribution platforms tend to follow a cycle: competitive consensus, identifying a moat, opening a third-party ecosystem…
  • Being early to a new platform matters because late adopters face shrinking windows, since platform cycles appear to be getting…
Lenny’s Podcast85 min

Inside the expert network training every frontier AI model

Garrett Lord · Aug 24, 2025
Key learnings
  • Post-training, not pre-training, now drives most model gains, so high-quality expert data targeting specific capability gaps is…
  • The labeling market has shifted from cheap generalist labor to domain experts, so the right supply is credentialed specialists…
  • Access to a trusted audience is the real moat in human data; owning an audience removes customer acquisition costs compared with…
Lenny’s Podcast115 min

Inside Bolt: From near-death to ~$40m ARR in 5 months—one of the fastest-growing products in history

Eric Simons · Mar 13, 2025
Key learnings
  • Eric Simons says deep technology bets can take years to find their market; his team stayed alive by bootstrapping and keeping…
  • Simons advises treating spending as a default no until you see real customer pull, and buying software with the goal of cutting…
  • Simons notes that when a launch unexpectedly takes off, pricing and infrastructure often break first; Bolt rolled out upgrade…
Lenny’s Podcast108 min

$46B of hard truths from Ben Horowitz: Why founders fail and why you need to run toward fear (a16z co-founder)

Ben Horowitz · Sep 11, 2025
Key learnings
  • Hesitation is usually the most destructive leadership mistake; when both options look bad, make an explicit decision rather than…
  • Leaders add real value only when they make decisions most people disagree with; if everyone agrees, the leader added nothing.
  • Success is built from a long chain of small, hard decisions, and each good choice sets up the next, so keep making the next one.