Elektrine lite

← Feed

@KevinMarks@xoxo.zone

Post #1723527

2025-10-22 11:51 UTC

Key findings: 45% of all AI answers had at least one significant issue. 31% of responses showed serious sourcing problems – missing, misleading, or incorrect attributions. 20% contained major accuracy issues, including hallucinated details and outdated information. Gemini performed worst with significant issues in 76% of responses, more than double the other assistants, largely due to its poor sourcing performance. https://www.bbc.co.uk/mediacentre/2025/new-ebu-research-ai-assistants-news-content

Replies (17)

  • @KevinMarks According to K-12 teachers, when kids in school want to say someone is spouting nonsense, without calling them a liar, they say “That’s #AI.” 

The kids are alright. It’s the #UnitedStates #economy that is undergoing #enshittification with #AIslop.

    Open ##1823228

  • @konosocio@mastodon.online 2025-10-22 13:35

    @KevinMarks I think we can improve on that by creating systems for DIY news - correct only 20% of the time but that is a loss we are willing to bear for the incredible advantage of only reading what you actually want to read.

    Open ##1823232

  • @ifrauding@don.linxx.net 2025-10-22 13:52

    @KevinMarks We are so 🤏🏼 close to AGI. I promise!!1!

    Open ##1823236

  • @dagb@snabelen.no 2025-10-22 14:30

    @KevinMarks The amount of capital spent on this is humongous, and the value is not correlating. This capital could be a lot more wisely be spent on solving the #ClimateCrisis or education, health aid or hunger in developing countries.

    Open ##1823237

  • @Sassinake@mastodon.social 2025-10-22 14:33

    @KevinMarks 'mansplaining as a service'

    Open ##1823238

  • @jerryjhird@mastodon.social 2025-10-22 14:52

    @KevinMarks crazy. thats almost half the percentage of how much BBC misrepresents news content

    Open ##1823239

  • @KanaMauna@sauropods.win 2025-10-22 16:48

    @KevinMarks So slightly better than a coin toss. Good job everybody, let’s burn a few more forests to celebrate.

    Open ##1823240

  • @teledyn@mstdn.ca 2025-10-22 17:10

    @KevinMarks Something something silk purse something something sow's ear … 😅

    Open ##1823241

  • @nitot@framapiaf.org 2025-10-22 17:26

    @KevinMarks good stuff, thanks for sharing, happy to have news from you again, sorry I did not follow you earlier :-) (I wish I did...)

    Open ##1823242

  • @gimulnautti@mastodon.green 2025-10-22 17:40

    @KevinMarks This does not surprise me one bit. The network only ”knows” within it’s training data. The rest is the reader’s gullibility not knowing better.

    Open ##1823243

  • @ayameow@plasmatrap.com 2025-10-22 17:50

    @KevinMarks@xoxo.zone If it's failing so bad at just processing text, imagine how inaccurate it must be at complex tasks. I can hear popping sounds.

    Open ##1823244

  • @3rdi@mastodon.social 2025-10-22 19:26

    @KevinMarks This is the purpose of AI

    Open ##1823246

  • @amostart@mastoart.social 2025-10-23 00:19

    @KevinMarks I am quite confident that a few years down the road, we are going to see some startling positive correlations between AI usage and early-onset dimentia. Use it or lose it is the anthem of neural pathways, and if you're not using them... well...

    Open ##1823247

  • @laydros@mastodon.sdf.org 2025-10-23 01:51

    @KevinMarks geez, what did they use to train these things, the internet!!?!

    Open ##1823248

  • @mistermups@mo-me.social 2025-10-23 10:30

    @KevinMarks 55% of the time, it works every time. All that cash and resource for something that's objectively worse than 'Sex Panther - By Odeon'. I mean you couldn't make it up really.

    Open ##1823249

  • @EdSanders@mstdn.social 2025-10-23 13:33

    @KevinMarks I’m starting to think of AI as a guy boiling water on a stove, but convincing suckers (and there are plenty who call themselves investors and bankers) that they are in the early days of developing fusion.

    Open ##1823250

  • @KevinMarks whilst I'm glad a proper study has been done, I'm not really sure if it matters. When such a high percentage of the public believe something, the truth becomes largely irrelevant. Saying AI isn't great seems like preaching to the converted now. I view AI like I view cults. I'm pretty sure that deep down, at home, with the curtains drawn and the lights off when cult followers would admit that some things they tow the line on are not correct. They also don't care as they'd rather be in than out. For whatever reason (I guess media and hope) a lot of people I know who support and use AI seem to gloss over all the negatives with "yes, well...", "is still new...", "it's improving..." and seem very happy with mediocre results it yields them. If it was any other thing I'm pretty sure they wouldn't touch it with a barge pole. It's easier to type an AI prompt than read a book that's mostly wrong. Maybe it's an effort thing.

    Open ##1823251