Post #1825677
2026-04-29 15:08 UTC
so apparently openai chatgpt codex 5.5 whatever it is wont stop talking about gremlins and goblins. which good (former) and bad (later). so they put in the system prompt "Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals or creatures unless it is absolutely and unambiguously relevant" and like WHY NOT JUST CHANGE THE TOKEN BIAS INSTEAD OF PUTTING IT IN THE SYSTEM PROMPT YOU FUCKUPS
Replies (1)
-
@gildilinie@beige.party 2026-04-29 15:25
its literally a command-line option in llama.cpp. --logit-bias 124567-whatever just look up the token for goblin. it has some id like 124567="goblin". then you put llama-server --logit-bias 124567-1. then it uses the word goblin less