Cost engineering

Making systems cheaper without making them worse.

2 posts

9 min read

Your Agent Re-Sends the Whole Conversation Every Turn

A multi-turn agent replays its entire history on every request. Caching, context editing and compaction each attack a different part of that bill — and one of them, at its defaults, made it worse.

10 min read

Your Observability Bill Is a Multiplication Problem

Cardinality does not creep up on you — it multiplies. Here is the arithmetic behind an exploding metrics bill, the four places the multiplication hides, and what actually shrinks it.