Model CPU offload on a 48 GB Mac: 18.5 GB footprint and 9.6 GB of swap
DEV Community
Model CPU offload on a 48 GB Mac: 18.5 GB footprint and 9.6 GB of swap
With diffusers' enable_model_cpu_offload, Qwen-Image-2.1 on a 48 GB Mac kept its footprint at 18.5 GB, but swap grew by 9.6 GB and the memory guard stopped it in the VAE decode.
0 comments
No comments yet.