Integer Quantisation and Rounding Error
DEV Community
Integer Quantisation and Rounding Error
The affine map derived from a real min and max, the s/2 error bound, the 6.02 dB per bit rule, and why 4-bit weighs 0.578 bytes rather than 0.5.
0 comments
No comments yet.