Elektrine lite

← Feed

@janellecshane@wandering.shop

2025-04-12 23:46 UTC

“Slopsquatting” in a nutshell: 1. LLM-generated code tries to run code from online software packages. Which is normal but 2. The packages don’t exist. Which would normally cause an error but 3. Nefarious people have made malware under the package names that LLMs make up most often. So 4. Now the LLM code points to malware. https://www.theregister.com/2025/04/12/ai_code_suggestions_sabotage_supply_chain/

Replies (19)

  • no problems ever with mimmic software packige Can trust yes

    Open ##2653108

  • @jwi@aus.social 2025-04-13 00:28

    @janellecshane@wandering.shop We know what happens when people lack critical thinking skills, so Tech Bros developed LLMs that lack critical thinking skills 🤔

    Open ##2653110

  • @Alkaris@meow.social 2025-04-13 00:45

    @janellecshane@wandering.shop The most common types of malware will of course be info stealers. Whats worse some of these code audits are now being done by AI by some developers who can't even go through their own code to see if everything checks out okay and doesn't contain malicious code, Microsoft has recently integrated this in to GitHub with Copilot to check code for malicious intent and security vulnerabilities. Quite recently Microsoft ran AI to find flaws in Linux bootloaders https://www.bleepingcomputer.com/news/security/microsoft-uses-ai-to-find-flaws-in-grub2-u-boot-barebox-bootloaders/

    Open ##2653111

  • @joshg@mathstodon.xyz 2025-04-13 01:14

    @janellecshane@wandering.shop Can I make a package for this that just makes fun of them publically

    Open ##2653112

  • @timnewsham@mastodon.social 2025-04-13 01:15

    @janellecshane@wandering.shop slop begets slop

    Open ##2653117

  • @Viss@mastodon.social 2025-04-13 02:03

    @janellecshane@wandering.shop

    Open ##2653118

  • @nev@bananachips.club 2025-04-13 02:50

    @janellecshane@wandering.shop wow, they found a way to make the left-pad problem *worse*

    Open ##2653119

  • @superflippy@mastodon.xyz 2025-04-13 02:51

    @janellecshane@wandering.shop I was surprised for a few seconds, then realized of course LLMs are just making up package names. They’re imitating real code, not actually coding. They don’t think or understand.

    Open ##2653120

  • @yon@sakurajima.moe 2025-04-13 02:53

    @janellecshane@wandering.shop Sink xor Swim.

    Open ##2653123

  • @adamrice@c.im 2025-04-13 03:21

    @janellecshane@wandering.shop

    Open ##2653124

  • @janellecshane@wandering.shop Don't forget making up REST API endpoints - just get the LLM to generate code and then register the domains. Why not publish some websites to scrape with your new domains so they're more likely to get selected?

    Open ##2653126

  • @xdej@mamot.fr 2025-04-13 06:34

    @janellecshane@wandering.shop 4. Now the LLM code is malware.

    Open ##2653128

  • @jfparis@rouge.eu.org 2025-04-13 07:18

    @janellecshane@wandering.shop Brilliant stuff @otfrom@functional.cafe

    Open ##2653129

  • @delProfundo@aus.social 2025-04-13 07:23

    @janellecshane@wandering.shop greeeeeaaaaaaaat. Totally worth it.

    Open ##2653130

  • @pautasso@scholar.social 2025-04-13 08:28

    @janellecshane@wandering.shop slopsquatting - a novel form of cybersquatting for the AI age also described in https://leanpub.com/unethical-software-engineering

    Open ##2653131

  • @janellecshane@wandering.shop I will not be sending this to anyone i know who generates code, i need to encourage them to be less aware of potential pitfalls so they're more likely to put their foot in one and be scared off using this tech by learning the lesson the hard way 🤣🥲

    Open ##2653132

  • @bmjhayward@fosstodon.org 2025-04-13 12:32

    @janellecshane@wandering.shop the future was supposed to be space travel and the jetsons but instead it's just weird

    Open ##2653133

  • @skc@scottodon.com 2025-04-19 03:19

    @janellecshane@wandering.shop vibe malware

    Open ##2653134

  • @soviut@hachyderm.io 2025-04-21 02:17

    @janellecshane@wandering.shop Worth noting that this issue has existed before LLMs. Bad actors would make packages for commonly mistyped package names; like "lowdash" instead of "lodash". Now you've accidentally installed a back door. In both cases the only real solution is to block known bad packages at the registry level (npm does this).

    Open ##2653135