I audited 78 API requests on my own gateway. One of them used 1,086 input tokens and returned 2 tokens. Token waste is real.
DEV Community
I audited 78 API requests on my own gateway. One of them used 1,086 input tokens and returned 2 tokens. Token waste is real.
I built a small API gateway for Chinese AI models (DeepSeek, etc.) and decided to audit my own token...
0 comments
No comments yet.