This week I received a few emails at work. Two of them were Copilot-generated. And I immediately recognized them as such, because the style was entirely wrong for the people who send the mails. One of the mails was refering to a meeting I had with that person. And the facts were entirely wrong. Things I said suddenly became things they said, things we agreed on changed... At this point I don't know if it was hallucinated or purposely prompted. My instinct is to pretend the mail was not generated but written. And full of lies. Because if I don't say anything, it becomes fact. Next time we speak about that project, they will say "But in my last email from march about that topic we agreed to..."

This is a problem. Because people stop thinking themselves and starting to offload their mental abilities to LLMs. Means if the LLM fucks up, they just don't know anymore. And can't even realize.