← Founder Notes
Archive ·

Prismml shipped bonsai 2 27b on september 17 with every weight reduced to a value in the set minus…

22:34 ISTby Yethikrishna R

prismml shipped bonsai 2 27b on september 17 with every weight reduced to a value in the set minus one, zero, or one, packing a 27 billion parameter model into 5.9 gigabytes at 1.76 effective bits per weight. the compressed version keeps 98 percent of the full precision score, up from 95 percent in the previous generation. the gap between quantized and full models is closing faster than the gap between frontier labs.

Share

Embed this note

<iframe src="https://founder.myndlabs.tech/notes/embed/prismml-shipped-bonsai-2-27b-on-september-17-Ddb7bSLCHs6" width="480" height="420" style="border:0;max-width:100%" loading="lazy" title="Prismml shipped bonsai 2 27b on september 17 with every weight reduced to a value in the set minus…"></iframe>

Original

More notes