Adapters, Hypernetworks and Modular Weights

The family LoRA belongs to, the structural reason it won — parallel rather than sequential — and the members that trade differently: prefix tuning, IA3, BitFit, hypernetworks.