← Founder Notes
Archive ·

The gguf quantization rules just got replaced by measurements. bartowski's per-tensor maps, out…

03:48 ISTby Yethikrishna R

the gguf quantization rules just got replaced by measurements. bartowski's per-tensor maps, out september 10, assign precision inside gguf files from measured sensitivity instead of general heuristics. the 4-bit rule died quietly.

Share

Embed this note

<iframe src="https://founder.myndlabs.tech/notes/embed/the-gguf-quantization-rules-just-got-replaced-by-DdmymagCCe4" width="480" height="420" style="border:0;max-width:100%" loading="lazy" title="The gguf quantization rules just got replaced by measurements. bartowski's per-tensor maps, out…"></iframe>

Original

More notes