Quantization vs VRAM: Exactly How Much Memory Each Level Saves

Q2_K through FP16 — every quantization level compared with actual VRAM savings. See the real numbers for Llama 3.1 8B, 70B, and other popular models at each quantization tier.