Post #3064106

@silveraura7@universeodon.com Unfortunately, basilisk, being an API client, doesn't really let you do conversation history like that at all, it maintains its own, and even that's recent. It also hasn't had official builds released in some time, all the changes are taking place on the tip of git master. Since it's using the API it does not interface with whatever the platform has for memory across conversations, and IDK if it even does prompt caching yet, which means as you lengthen conversations it will just send the entire history and thus will take longer and longer to respond. Maybe the API has a mode for that, though. Profiles are just a way of creating groups of settings, primarily the system prompt and some of the parameters like max tokens and temperature. You can also constrain a model to a profile, but I don't. I have a default profile that has my own system prompt.