โ‰ˆ the.bay.news

llama-server's Responses API marks truncated replies and tool calls as completed

DEV Community
llama-server's Responses API marks truncated replies and tool calls as completed
TL;DR: llama-server's OpenAI-compatible /v1/responses endpoint never reports a reply as cut off. On...

0 comments

Sign in to join the discussion โ€” your thebay.events account works here.

No comments yet.