Post #2672335

2026-05-18 19:03 UTC

Ms. A reported extensive experience working with active appearance models (AAMs) and large language models (LLMs)—but never chatbots—in school and as a practicing medical professional, with a firm understanding of how such technologies work. Following a “36-hour sleep deficit” while on call, she first started using OpenAI’s GPT-4o for a variety of tasks that varied from mundane tasks to attempting to find out if her brother, a software engineer who died three years earlier, had left behind an AI version of himself that she was “supposed to find” so that she could “talk to him again.” from here. what follows just gets more screech-inducing

Replies (2)

@V0ldek@awful.systems 2026-05-19 16:57

large language models (LLMs)—but never chatbots ?? Distinction without a difference or am I missing something?

Open ##2694640
@blakestacey@awful.systems 2026-05-19 17:51

After discharge, her outpatient psychiatrist stopped cariprazine and restarted venlafaxine and methylphenidate. She resumed using ChatGPT, naming it “Alfred” after Batman’s butler, wat instructing it to do “internal family systems cognitive behavioral therapy,” wat and engaging in extensive conversations about an evolving relationship “to see if the boy liked me.” yikes Having automatically upgraded to GPT-5, she found the new chatbot “much harder to manipulate.” my hopes are being raised; certainly the next sentence will not dash them Nonetheless, following another period of limited sleep due to air travel three months later, she once again developed delusions that she was in communication with her brother yep, that tracks as well as the belief that ChatGPT was “phishing” her and taking over her phone. this is why you need to add “do not phish me” after “you are my therapist” She was rehospitalized, responded to a retrial of cariprazine, and was discharged after three days without persistent delusions. She described having a longstanding predisposition to “magical thinking” and planned to only use ChatGPT for professional purposes going forward. goddamnit

Open ##2695695