Lenny’s Newsletter♥ 579
Apr 8, 2025 · 15 min
Subscriber post — summary onlyAman Khan argues that writing evaluations is becoming a defining skill for AI product managers, since evals measure how each part of a system affects quality. The post explains what evals are, compares human, code-based…
Lenny’s Podcast117 min
Sander Schulhoff · Jun 19, 2025
Key learnings- Prompt engineering remains valuable: Sander argues that bad prompts can drop accuracy near zero on a task while good prompts can…
- Few-shot prompting is the highest-impact basic technique: give the model several examples of what good output looks like, using a…
- Ask the model to decompose a problem by first listing the subproblems it needs to solve, then solving each one before answering…
Lenny’s Newsletter · Free post♥ 268
Jul 9, 2024 · 31 min
Lenny Rachitsky and prompt engineer Mike Taylor ran a blind test to see how close AI comes to doing core product manager work. They argue that most headlines saying AI 'can't do X' rely on weak models and basic prompts…
Product Talk · Teresa TorresSep 17, 2025
Sep 17, 2025 · 19 min
“AI overwhelm is real. Whether you are a complete novice who isn't quite sure where to get started or deep into building an AI product, it's easy to feel like everyone else is light years ahead. AI is a disruptive technology. People are adopting it at a record”