โ‰ˆ the.bay.news

Behavioral thermodynamics: a LoRA behavior melts at 3.5x its RMS noise

DEV Community
Behavioral thermodynamics: a LoRA behavior melts at 3.5x its RMS noise
Gaussian noise on every LoRA tensor: SST-2 stays at 94.5% up to 2x RMS, then collapses to chance at 5x. Half-gain at sigma=3.47.

0 comments

Sign in to join the discussion โ€” your thebay.events account works here.

No comments yet.