Topic in Consumption
Efficiency
-
Part of What a token really costs
Every call sends the whole history again
An agent sends its whole conversation with every call, so each call costs more than the one before.
-
Part of What a token really costs
You pay for thinking you never see
More than two thirds of the output tokens in this site's build were thinking, paid for at the output price and mostly never shown.