Post #3360439
2026-06-19 15:34 UTC
@FRYTG@beoriginal.social Hermes as a vm on top of Proxmox. Llama.cpp on the backend on the Mac
Replies (1)
-
@FRYTG@beoriginal.social 2026-06-20 13:29
@ironicbadger@techhub.social running it as separate vm sounds good, i'm currently playing with a normal docker setup. how's the llama/model performance when running locally?