X · X post · Building AI products · Metrics, data & experimentation

I'm seeing a huge difference in performance (in a bad direction) across my evals…

Teresa TorresJul 21, 2026♥ 3
SourceX
KindX post
PublishedJul 21, 2026
Readers♥ 3
Originalx.com ↗
X:
I'm seeing a huge difference in performance (in a bad direction) across my evals moving from Sonnet 4.6 to Sonnet 5. Previously, my service ran at temperature 0. I'm wondering what prompt strategies people are using to constrain Sonnet 5 now that temperature is no longer an option.Teresa Torres on X · Jul 21, 2026

Teresa Torres asks how to constrain Sonnet 5 outputs for evals now that temperature control is unavailable.

Summary and takeaways written by PM Atlas; quotes are short excerpts. © the original author.