Justin Sheehy

"Rogue AI" sure does get a lot more headlines and freakouts than "badly written program" despite that being what this is about. Similarly "it escaped containment" sounds like an alien or monster broke down a wall, instead of "the program we wrote was run in an environment that was connected to other computers and not secured." It would be cool if major-media reporters did their jobs instead of just repeating the talking points that they're handed.

RE: @grimalkina@mastodon.social

This is excellent. Having seen Cat speak elsewhere, I wish I’d been in the room for this talk in order to get the spoken parts in addition to the slide content.

Not only were there valuable insights about the surface topic, the framing of effective learning resonated with me as an active teacher of a physical (not technological) discipline as well.

Just got a text from one of my kids that they're at an invited talk (at their university) by @emilymbender@dair-community.social -- right on.

@neil@mastodon.neilzone.co.uk We tried to find a balance on how attestation could be meaningful without degrading user control of their own systems when we looked forward in the direction of this problem about 20 years ago.
(paper was published about 4 or 5 years after we wrote it)
In general, it can be a complicated problem with semi-competing interests.

Principle 3 in the abstract is about the user's ability to constrain disclosure during attestation.
https://www.researchgate.net/publication/220066790_Principles_of_remote_attestation

This post by @mttaggart@infosec.exchange is one of the most thoughtful posts by a programmer on GenAI that I have seen in a while. Wrestling with our own conflicting perspectives and feelings about this is hard work, and important.

https://taggart-tech.com/reckoning/

I saw a paper (by some GenAI skeptics?) that concluded "we find that AI use impairs conceptual understanding, code reading, and debugging abilities, without delivering significant efficiency gains on average."

Oh, wait, it wasn't some anti-AI authors. It's from Anthropic.

https://arxiv.org/abs/2601.20245

@joel@gts.tumfatig.net If a teacher over-focuses on “how” and isn’t prepared and willing to get into “why” then I don’t expect that they have much depth to share. If they happily go into why they do things the way they do, then even if I disagree or do things differently then I am inclined to listen to see what might be worth learning or at least thinking about.

@rckenned@hachyderm.io Trick question! The model doesn't know anything other than "here are more tokens" and so it can't know that what it gives you is patented. Arguably, both the creators of the model and the users of the model might be infringing, in different ways, but both sides of that are as yet untested.

@ibboard@hachyderm.io The weird thing with that is that you could reasonably (from a legal point of view) claim copyright on a prompt! Just not on the output from a model that you used the prompt with...

@cbarbermd@med-mastodon.com

He does like to make predictions. They don't tend to be accurate.

Just one recent example:
https://futurism.com/six-months-anthropic-coding

Those baseless predictions have a very real cost:
https://hbr.org/2026/01/companies-are-laying-off-workers-because-of-ais-potential-not-its-performance

Fascinatingly, this is essentially not related (in a legal sense) to the fact that when you use such a system you are likely to get some material that someone else has a copyright interest in and which is being provided to you with no regard for that creator's rights.

If you "vibe code" something, or otherwise get a GenAI system to provide an output (image, code, text, whatever) based on your prompting, you ought to understand that you do not have any ownership in either the copyright or patent sense of that output. You didn't make it!

This means that you have effectively no legal basis to restrict what other people do with it. You cannot apply a copyright license to it, for example, or assign copyright to your employer or anyone else.

Ref:
https://www.theverge.com/policy/887678/supreme-court-ai-art-copyright
https://copyright.gov/ai/Copyright-and-Artificial-Intelligence-Part-2-Copyrightability-Report.pdf
(the WTO and relevant treaties make this not only a US fact, despite me citing US-centric sources)

It could be interesting to start calling the kind of abusive scraping, theft, and regurgitation that all the major LLM-bros base their whole product around as "distillation attacks."

If someone says they meant something else when they made up that term, the conversation about describing the distinction ought to be fun.

https://www.theregister.com/2026/02/14/ai_risk_distillation_attacks/

What they're angry about (and asking the government to prevent!) sure does look a lot to me like what they themselves have done to... everything else on the web.

This is Meta's head of AI "safety" doing more than making a “rookie mistake" as she put it.

The biggest failing here, imo, was not letting a probabilistic chatbot have full control over her email account. That's bad, but even worse is anthropomorphizing the LLM.

When it started to "misbehave" (remember, they don't have any real sense of true/false, and "rules" that you give them are just more text for the blender) she started pleading "don't do that" as though it was a person. It's a computer program. You can just turn it off.

This is part of the danger of using the intentionally misleading language that everyone has been pushed into using about these, such as (but definitely not limited to) "hallucination." Even people whose full time job is about this problem get tricked into forgetting what these are, and what they are not.

https://www.404media.co/meta-director-of-ai-safety-allows-ai-agent-to-accidentally-delete-her-inbox/

@cstross@wandering.shop @timnitGebru@dair-community.social @emilymbender@dair-community.social @alex@dair-community.social and since you could… https://www.sumppumpsdirect.com/NexPump-X-TREME-PLUS-ANI-Sump-Pump/p166319.html

@mweagle Yeah, @rstephensme knows what she's talking about. Something I just mentioned as a throwaway line (something like "writing code was never the hard part") in https://www.infoq.com/presentations/responsible-development-ai-hype/ is examined with much more depth and thoughtfulness by her here.