One Misplaced Block Made Every Message Rewrite 19,000 Cached Tokens
DEV Community
One Misplaced Block Made Every Message Rewrite 19,000 Cached Tokens
Prompt caching is the cheapest win in an AI coding agent. The system prompt and tool definitions are...
0 comments
No comments yet.