≈ the.bay.news

What broke when we ran agents on small local models

DEV Community
What broke when we ran agents on small local models
Five real failures from running Bees agents on 3B and 4B models with llama.cpp: a tool-call format that changed mid-run, tools the model was told to use but never shown, a tool cap that killed long runs, a thinking model that outran a timeout, and pr

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.