Cider Quantization: Engineering Trade-offs in On-Device Inference

Most conversations about on-device models start and end with one question: how much did quantization...