Skip to content

PM Atlas 1,782 notes · updated Oct 8Search

Framework · 2 notes · discussed by Edwin Chen, Jason Droege

Reinforcement Learning Environments

Every note in the archive that names Reinforcement Learning Environments: summaries, key takeaways and links to the original essays, episodes and posts. Ask a question below to get a cited answer from just these notes’ authors.

Lenny’s Podcast97 min

The 100-person AI lab that became Anthropic and Google's secret weapon

Edwin Chen · Dec 7, 2025

Key learnings

Define quality in rich, specific terms for each domain (e.g., what makes a poem Nobel-worthy, not just whether it has eight…
Gather thousands of signals on each worker and task, from background and expertise to performance, and use them like an ML…
Don't trust benchmarks at face value: many contain wrong answers, and optimizing for them can make models worse at messy…

Lenny’s Podcast110 min

First interview with Scale AI’s CEO: $14B Meta deal, what’s working in enterprise AI, and what frontier labs are building next

Jason Droege · Oct 9, 2025

Key learnings

Model improvement now relies heavily on experts (80% of Scale's expert network holds a bachelor's or higher) defining what good…
Enterprise AI pilots that reach 60-70% accuracy feel close, but robust automation of important processes often takes 6-12 months…
Validate a new business by checking whether it can sustain high gross margins and whether competitors can match the economics in…