Post #4415875

Lol you can degrade a model with bad training I kept playing with the xss model and slowly it began degrading from its once high spot. It was interesting to try and debug why it was getting worse lol. I think there may be a sweet spot for the llm and rl but over doing it degrades model performance.