Lenny’s Podcast116 min
OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more
Kevin Weil · Apr 10, 2025
Key learnings
- Build products at the edge of current model capabilities, since models improve every few months and a barely-working product can…
- Treat evals as unit tests for models: define hero use cases, write evals for them, and hill-climb on those evals to know whether…
- Expect AI behavior to be fuzzy: a model right 60%, 95%, or 99.5% of the time implies very different product designs, so study…