Skip to content

Notes

What we learned on engagements, written down while it was still annoying. Mostly retrieval, evaluation, and the cost of running models at volume.

Write the eval before you write the prompt
Teams that cannot measure a retrieval system end up arguing about it instead, and the argument always costs more than the eval would have.
14 Oct 2026