They cannot create something new, they can just remix what already exists.
They’re not even especially great at that. Because they lack judgement, they either adhere to instruction too closely, or not closely enough. And because the transformer will always return something with non-zero probabilities attached, “I don’t know how to complete this string of words” isn’t really in their vocabulary. They will complete the string, and the next, and the next, and the one after that until they reach some kind of token limit or defined stopping point, making their remixes… really, really bad. Not every time, of course, but they will, inevitably, fuck something up sooner or later with 100% probability if left to run.
And the most frustrating thing is, they’re not even especially great at the things that they’re best equipped to do, such as re-writing things in different styles.
