≈ the.bay.news

Model CPU offload on a 48 GB Mac: 18.5 GB footprint and 9.6 GB of swap

DEV Community
Model CPU offload on a 48 GB Mac: 18.5 GB footprint and 9.6 GB of swap
With diffusers' enable_model_cpu_offload, Qwen-Image-2.1 on a 48 GB Mac kept its footprint at 18.5 GB, but swap grew by 9.6 GB and the memory guard stopped it in the VAE decode.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.