@bitbraindev@mastodon.gamedev.place
Post #3974895
2026-07-20 21:28 UTC
@NanoRaptor@bitbang.social it's kinda crazy how bad the hallucination rate is of LLMs. You actually can get extremely close to 100% reliability but it requires some arcane trial and error of guessing the exact sequence of system prompt tokens but hold on you just included this specific word that for whatever reason completely breaks the attention mechanism and now the output is all wrong and never mind 🥲
Replies (1)
-
@RyeNCode@mstdn.ca 2026-07-21 02:03
@bitbraindev@mastodon.gamedev.place @NanoRaptor@bitbang.social suppose you do get something reliable, How long until that model & system prompt combo is removed or altered. Either with notice or without. Still betting with hidden odds, secret sauce and the house is changing the game rules. Maybe they will let you know what they are if they ever fight out what they did.