Your LLM fallback model is a second price list. One outage day on the wrong one adds 70% to the month.
DEV Community
Your LLM fallback model is a second price list. One outage day on the wrong one adds 70% to the month.
When the main model is down, every request goes to the fallback and is billed at its prices. At list prices, falling back from Claude Haiku 5.5 to GPT-5.6 makes each call 22x more expensive, one outage day adds 70% to the month, and requests between 400K and 1M tokens can't fall back at all. Here's how to choose a fallback by two numbers.
When the main model is down, every request goes to the fallback and is billed at its prices. At list prices, falling back from Claude Haiku 5.5 to GPT-5.6 makes each call 22x…
0 comments
No comments yet.