Post #1913839
2026-04-06 20:30 UTC
@SnoopJ it's a little frustrating how the safetensors folks seem to think all the world is an LLM.
Compression was dismissed b/c model weights are “incompressible by design” and… that is just not true outside of a gradient descent dense matrix.
Glad to have your +1 to HDF5 not being a terrible idea.
Replies (1)
-
@SnoopJ@hachyderm.io 2026-04-06 20:38
@mdekstrand "incompressible by design" … wat :blobfoxgooglyconfused: the madness I encounter most often is "ah, let's just do something on top of pickle" and that is the path to full madness