- Floating point math is deterministic.
- Systems don’t have to be programmed with race conditions. That is not a fundamental aspect of an LLM, but a design decision.
- Systems don’t have to be programmed to tie break with random methods. That is not a fundamental aspect of an LLM, but a design decision.
This is not hard stuff to understand, if you understand computing.