dynamo-trtllm-sidecar v1.6.1 — Dynamo TensorRT-LLM sidecar backend — drives an out-of-process TensorRT-LLM engine over its OpenEngine gRPC service through the backend-common LLMEngine trait.

Sign in to join the discussion — your thebay.events account works here.