Quantization

Reducing the numeric precision of model weights (fp16 → int8 → int4) to shrink memory footprint and speed up inference with minimal quality loss.