Post #3834643
2026-07-15 14:50 UTC
When the proportion of processing to benefit is that far out of whack it is useless.
Replies (2)
-
@RedstoneValley@sh.itjust.works 2026-07-15 15:32
Especially if you could use the space to display what the model is actually doing, like the thinking process or other current model states (prefill, decode, idly waiting for a slot…)
-
@brotundspiele@sh.itjust.works 2026-07-15 15:38
Wrong. If more processing power is used for displaying the spinner, then the actual task will take longer, thus the spinner will be displayed for a longer time, so the spinner becomes even more useful.