ShrinkAI: knowledge distillation and compression package
PyTorch Forums
ShrinkAI: knowledge distillation and compression package
I just released shrinkai, a python package for reducing neural network size and inference latency (distillation + pruning + quantization), that could be useful for edge/mobile deployment. Built to feel native if you already know PyTorch, there is no custom training loop required, except if you need one. Here are the main objects: Distiller, allowing distillation from a teacher to a student, with already provided losses (logit-based, feature-based, attention transfer, hybrid, …) Pruner / Channe...
0 comments
No comments yet.