Ming-3.0-tts on a 16 GB card: the GPU sat mostly idle, and why a bigger one barely helps
DEV Community
Ming-3.0-tts on a 16 GB card: the GPU sat mostly idle, and why a bigger one barely helps
Ming-3.0-tts-0.5B peaked at 2.9 GB and ran at about 0.65x real time. The Python decode loop sets the pace, not the card. What to measure first.
0 comments
No comments yet.