Post #3634950

2026-07-06 16:44 UTC

Can I shit on Google Translate "improved accuracy with Gemini AI" some more please? The "translation" says 静寂の帳（とばり）が降りる時、星々は密やかに語り合う。時の流れは緩やかに、夢の続きを紡ぎ出す。 Which is a hallucinated little poem in Japanese. Yes, it completely ignores the translation task and acts like a chatbot it is.

Replies (5)

@nina_kali_nina@tech.lgbt 2026-07-06 16:47

It gets better. This time the poem Google Translate hallucinated is roughly: > I am an AI agent. The melody of words resonating in the silence, the brilliance of knowledge woven from data. Answering questions, illuminating new paths, a guide traversing the digital ocean.

Open ##3634949
@gabrielesvelto@mas.to 2026-07-06 16:54

@nina_kali_nina@tech.lgbt as someone with a long time interest in natural language processing I find this stuff an insult to decades of research. The goal was to program computers to interpret natural language and instead we've programmed them to fool people into thinking they can interpret natural language. What a shame.

Open ##3638527
@Ertain@mast.linuxgamecast.com 2026-07-06 16:54

@nina_kali_nina@tech.lgbt My head, it be shaking.

Open ##3640364
@scvalex@mas.to 2026-07-06 17:14

@nina_kali_nina@tech.lgbt FWIW DeepL Translate (which I assume also uses an LLM of some sort) doesn't fall for this trick: https://www.deepl.com/en/translator

Open ##3640369
@wall_e@ioc.exchange 2026-07-17 08:38

@nina_kali_nina@tech.lgbt wait... so Google Translate basically is vulnerable to prompt injection and does not behave like a translator anymore but a general purpose Gemini LLM?

Open ##3880716