Lenny’s Podcast97 min
The 100-person AI lab that became Anthropic and Google's secret weapon
Edwin Chen · Dec 7, 2025
Key learnings
- Define quality in rich, specific terms for each domain (e.g., what makes a poem Nobel-worthy, not just whether it has eight…
- Gather thousands of signals on each worker and task, from background and expertise to performance, and use them like an ML…
- Don't trust benchmarks at face value: many contain wrong answers, and optimizing for them can make models worse at messy…