Post #2728016

@Enzo90910@iosdev.space @softmaus@mastodon.social @gernot@mas.to Nah, not really. Tried the biggest ones I could cram into 32 GB VRAM and they turned out to be completely unusable for agent tasks. Like ridiculously bad in comparison. A really huge model on a machine with tons of RAM may work, but is far more expensive than to just get a couple of subscriptions. Self-hosting IMO won't make any sense for quite a while.