Post #1536176

I find it's a really interesting problem, and a hard one for sure. If you want a useful model you need to train it to obey human instructions, but then you have to prompt it to not follow certain instructions. It becomes prompt vs training and, well, sometimes the training wins.