What is an LLM gateway? Why teams put LiteLLM between their apps and model providers
DEV Community
What is an LLM gateway? Why teams put LiteLLM between their apps and model providers
An LLM gateway is one API in front of many model providers that adds routing, fallbacks, budgets, keys and cost tracking. What it does, when you need one, and what can go wrong, from a LiteLLM contributor.
0 comments
No comments yet.