the.bay.news

Show HN: Shoehorn – Quantize any model down to run on your machine

shoehorn
Show HN: Shoehorn – Quantize any model down to run on your machine
Solves a per-tensor quantization that uses 99.99% of your exact VRAM budget — every spare megabyte spent where it buys the most quality. macOS, Linux, and Windows.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.