S-LoRA: Multiplexing Thousands of Fine-Tuned Adapters on a Single GPU

How Unified Paging and scalable LoRA adapter serving allows cloud platforms to host 10,000+ custom fine-tuned models concurrently on a single GPU without OOM errors.