Behavioral thermodynamics: a LoRA behavior melts at 3.5x its RMS noise
DEV Community
Behavioral thermodynamics: a LoRA behavior melts at 3.5x its RMS noise
Gaussian noise on every LoRA tensor: SST-2 stays at 94.5% up to 2x RMS, then collapses to chance at 5x. Half-gain at sigma=3.47.
0 comments
No comments yet.