the.bay.news

ShrinkAI: knowledge distillation and compression package

PyTorch Forums
ShrinkAI: knowledge distillation and compression package
I just released shrinkai, a python package for reducing neural network size and inference latency (distillation + pruning + quantization), that could be useful for edge/mobile deployment. Built to feel native if you already know PyTorch, there is no custom training loop required, except if you need one. Here are the main objects: Distiller, allowing distillation from a teacher to a student, with already provided losses (logit-based, feature-based, attention transfer, hybrid, …) Pruner / Channe...

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.