Post #2727394
2026-05-20 20:31 UTC
What kind of token per second are you getting with your model partially on disk?
Replies (1)
-
@amorangi@lemmy.nz 2026-06-13 22:08
I think it was a video workflow, and it wasn’t too bad as it kept the main model in vram and was efficiently passing out whatever it was passing out. But it took nearly all of my 64GB of ram. From memory it was about 20min for a 5 second clip. Not great but not horrible.