Post #3302092
2026-06-08 23:46 UTC
It’s pretty funny that the #wwdc platforms state of the union has an example using private cloud compute at a temperature of 1.0 for creativity, and if you read the release notes for any of these new platforms, PrivateCloudComputeLanguageModel always uses greedy decoding.
lol
(FB is 178181782, per Apple)
This is… not a small issue to launch to developers with.
#Apple
Replies (1)
-
@dotsie@mastodon.social 2026-06-08 23:48
(that temperature setting will be totally null with this ‘bug’ and you will get the same logits every time modulo precision or infrastructure errors)