Show HN: Shoehorn – Quantize any model down to run on your machine
shoehorn
Show HN: Shoehorn – Quantize any model down to run on your machine
Solves a per-tensor quantization that uses 99.99% of your exact VRAM budget — every spare megabyte spent where it buys the most quality. macOS, Linux, and Windows.
0 comments
No comments yet.