Post #531931

Yeah they’re going to cost as much as a house. I think we’ll see much larger active portions of larger MOEs, and larger context windows, which would be useful. The non LLM models I run would benefit a lot from this, but I don’t know of I’ll ever be able to justify the cost of how much they’ll be.