Your User Closed the Tab. Your Node Server Is Still Paying for the LLM Call
DEV Community
Your User Closed the Tab. Your Node Server Is Still Paying for the LLM Call
A streamed LLM call keeps running after the browser disconnects unless you cancel it. Wire one AbortSignal from Node's socket to the SDK and your tools.
0 comments
No comments yet.