Framework · 1 note · discussed by Karina Nguyen

Synthetic Data Training

Every note in the archive that names Synthetic Data Training: summaries, key takeaways and links to the original essays, episodes and posts. Ask a question below to get a cited answer from just these notes’ authors.

Q:
Answers quote and cite the source notes
Lenny’s Podcast81 min

OpenAI researcher on why soft skills are the future of work

Karina Nguyen · Feb 9, 2025
Key learnings
  • Build rigorous evals first: define deterministic pass/fail behaviors (e.g., correct time handling) and human win-rate comparisons…
  • Use prompting as a fast prototyping method to test product ideas before engineering investment, as Karina did with file uploads…
  • Synthetic data scales cheaply for teaching core product behaviors, but human expert data is still needed for specialized…