Post #1730350

Apparently, you buy some currency called AI Units and this is the rate the different LLMs consume them. The multipliers used to represent requests I think, i.e. times you triggered inference, but ai units are a proxy for token burn in a somewhat vague way, which makes me think there will be rate limit related controversies similar to what’s now happening with anthropic. Existing enterprise user get double the AIUs for three months to ease them to the new model, so autumn’s gonna be fun.