1. Floating point math is deterministic.
2. Systems don’t have to be programmed with race conditions. That is not a fundamental aspect of an LLM, but a design decision.
3. Systems don’t have to be programmed to tie break with random methods. That is not a fundamental aspect of an LLM, but a design decision.

This is not hard stuff to understand, if you understand computing.