vLLM's --api-key leaves /invocations, /tokenize and /pause open. Lock it down with an allowlist proxy
DEV Community
vLLM's --api-key leaves /invocations, /tokenize and /pause open. Lock it down with an allowlist proxy
If you run vllm serve --api-key ... and think the server is now private, read vLLM's own security...
0 comments
No comments yet.