Post #2312673

Downloadable models are already becoming good enough to self-host. And the fun thing is, the US is indirectly responsible for it - its sanctions to China regarding high-power GPUs forced them to make do with the mid-power ones they did have, thus optimizing the models to be viable to self-host at home (as long as you can get a card with 16 GB of VRAM somehow, or a device with an unified architecture like the new Macs)