Post #1223850
2026-03-18 04:04 UTC
@dhobern There are also "Mixture of Experts" where there's a router that processes the tokens of the input as they run through the system and routes those to models that are "specialized" on a given thing, and then recomposes it out the other end.
But again, statistics.
Replies (1)
-
@cthos@mastodon.cthos.dev 2026-03-18 04:12
@dhobern And "Reasoning" models literally just run themselves in a loop, feeding the output from one iteration back to itself a number of times with the aim to improve a result. I don't actually know how they determine when to stop looping, I presume it's when it hits / outputs a stop token.