≈ the.bay.news

Temperature 0, same model, two different GPUs: find the word that splits them, then pin it

DEV Community
Temperature 0, same model, two different GPUs: find the word that splits them, then pin it
Greedy decoding on the same GGUF still flips an answer between two cards. Here is a script that finds the exact token where two runs part, the one stock setting that stops it, and a CI gate that keeps a reproducibility claim honest.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.