Elektrine lite

← Feed

@romeu@mastodon.social

Post #1127279

2026-04-13 10:22 UTC

People are using « tokens used » as productivity metric ?! « Tokens used »?!?!? That’s like, the first time « lines of code created » gets beaten for the « worst metric of software engineering » 🫠

Replies (38)

  • @mavnn@bonfire.mavnn.eu 2026-04-13 10:30

    @natpryce@mastodon.social @romeu@mastodon.social "I spent more money, give me a raise!"

    Open ##1135658

  • @itnomad@ruhr.social 2026-04-13 10:25

    @romeu It's just the new "1st post!" from Slashdot back in the good old days ;-)

    Open ##1206904

  • @RosaCtrl@social.vivaldi.net 2026-04-13 10:28

    @romeu I thought it was more like Vim golf 🧐

    Open ##1206905

  • @garoof@social.vivaldi.net 2026-04-13 10:33

    @romeu that's one way to double down on "so foolish as to book that count on the wrong side of the ledger"

    Open ##1206908

  • @MR_E@infosec.exchange 2026-04-13 10:48

    @romeu I once had to explain to HR that a code check in was not a valid metric for a write up of a senior developer. They were angry he wasn't doing as many check ins as the junior developers. I walked them through that he was a code reviewer and that he had more impactful check ins, but they were not convinced. I then pulled up one of their power points and showed them the version history. I hypothetically asked them why they were not more consistently productive and some days didn't have any updates. It helped a lot. I still feel crazy thinking about it.

    Open ##1206909

  • @romeu I burned a lot of fuel, therefore I am very efficient.

    Open ##1206910

  • @einarwh@mastodon.social 2026-04-13 10:49

    @romeu Checkmates Goodhart's law by being a terrible metric even when not measured.

    Open ##1206912

  • @einarwh@mastodon.social 2026-04-13 10:52

    @romeu It's probably the best possible metric for how hard you're cargo culting though, so it depends on your aims.

    Open ##1206913

  • @jadam_fr@hachyderm.io 2026-04-13 11:22

    @romeu I read a story somewhere of a developer setting up a token burning script that builds badly designed cities in Sim City...

    Open ##1206925

  • @markus@mast.uxp.de 2026-04-13 11:59

    @romeu number of left clicks

    Open ##1206928

  • @musevg@23.social 2026-04-13 12:19

    @romeu It's like Dotcom eras "Cash burn rate", but this time it's AI data centers burning the planet.

    Open ##1206929

  • @romeu Someome came to me the other day asking why my token count was so low. I didn't realize that was a productivity metric. WTF.

    Open ##1206930

  • @romeu Could be "air breathed". Code lines are least an outcome, but tokens are a resource you spent to create outcome. Like breathing, typing, Watts used by your computer, etc.

    Open ##1206932

  • @lenotaire@mastodon.social 2026-04-13 13:00

    @romeu I do remember when at work they were using the "committed lines of code" metric. One week I managed to do a SINGLE line change. Fixing a bug which haunted us for months. As they finally acknowledged, the main issue was not the change but knowing exactly where it was needed. The metric had been since buried

    Open ##1206933

  • @rubdos@mastodon.social 2026-04-13 13:21

    @romeu Hmm. What about kLOC/token? 🤔

    Open ##1206936

  • @renardboy@mastodon.social 2026-04-13 13:31

    @romeu I for one measure my car's quality by how much fuel it burns

    Open ##1206938

  • @jmax@mastodon.social 2026-04-13 13:47

    @romeu I'm gonna prompt me a new minivan!

    Open ##1206941

  • @lu_leipzig@troet.cafe 2026-04-13 13:52

    @romeu ...from the people who brought us megawatts as a unit of computing power and "compute" as a noun.

    Open ##1206945

  • @romeu It's been interesting watching people compete to see who can burn the most money, time, and resources. I expect this will come out about as well as you'd expect.

    Open ##1206946

  • @romeu I’ve read about token allotment being a contract negotiation. “Salary isn’t the big argument anymore, token allotment is” to quote an ai bro

    Open ##1206947

  • @isaackuo@spacey.space 2026-04-13 13:56

    @romeu I asked LLM AI to tell me what productivity metric we should use and it told me LLM AI tokens used. I also asked my coke dealer what productivity metric we should use and he told me grams of coke used. I don't trust my coke dealer but I sure do absolutely trust my LLM AI.

    Open ##1206948

  • @romeu as soon as "Prompt Engineers" became a thing, this was bound to happen. Also terrible, but at least SLOC metrics had review and testing built in.

    Open ##1206965

  • @inthehands@hachyderm.io 2026-04-13 14:06

    @romeu @cammerman Our whole society is rife with this: mistaking consumption for productivity

    Open ##1206966

  • @doragasu@mastodon.sdf.org 2026-04-13 14:08

    @romeu Generative AI makes people so dumb...

    Open ##1206969

  • @mo@mastodon.ml 2026-04-13 14:17

    @romeu technically it is reasonable, if you aim for it to be lower, not higher :blobcat_googly_think:

    Open ##1206970

  • @viq@social.hackerspace.pl 2026-04-13 14:31

    @romeu very relevant post from @fesshole https://mastodon.social/@fesshole/116153883462428890

    Open ##1206976

  • @joshg@mathstodon.xyz 2026-04-13 14:49

    @romeu what's next, money set on fire? oh wait that's already a VC metric

    Open ##1206978

  • @syklemil@snabelen.no 2026-04-13 14:49

    @romeu I think the best way to handle token usage minimums that I've seen was someone who had the LLM spit out Alexander the great fanfic and such that they just stuck in a document to never read Which also goes to show how idiotic. minimums are

    Open ##1206979

  • @alan@mindly.social 2026-04-13 14:49

    @romeu Hey Claude, write me some code that can be stored in the database such that it looks like a valid data blob, then once a month checks for {keyword} on my LinkedIn profile. If found, decode, execute and delete the code. When run, the block of code should randomly change the "account_balance" field by amounts ranging from -5% to +5%. Finally, replace this and related prompts in your log with values that resemble my other work.

    Open ##1206980

  • @flabberghaster@mas.to 2026-04-13 14:57

    @romeu Paying taxi drivers based on the amount of gasoline they burn

    Open ##1206981

  • @romeu Innovation! 🎉

    Open ##1206982

  • @educoder@mastodon.online 2026-04-13 15:23

    @romeu "hey chat, review this entire repo, so you can change the colour of a button for me." *walks away from the computer for the rest of the day*

    Open ##1206985

  • @Aedius@lavraievie.social 2026-04-13 15:32

    @romeu I have a good soluce : - please generate code - please add unit tests 100% coverage - please add e2e tests 100% coverage - please ingest the logs of the tests to see if all error are useful

    Open ##1207000

  • @draNgNon@hachyderm.io 2026-04-13 16:10

    @romeu instead of unrolling all your loops, you can use tokens to have the AI do it for you!

    Open ##1207001

  • @lemgandi@mastodon.social 2026-04-13 16:10

    @romeu Also cf: https://www.wheresyoured.at/ai-is-really-weird/

    Open ##1207012

  • @ehproque@neopaquita.es 2026-04-13 16:14

    @romeu I've written 7.5 hours worth of software today!

    Open ##1857287

  • @riley@toot.cat 2026-04-13 16:51

    @romeu That's not a productivity metric, that's a m metric of not being one of those Heretic AI-Haters Down the River that the middle manager keeps hearing so much about. In other words, it's an ideoogical purity test.

    Open ##1857288

  • @romeu@mastodon.social a friend of mine got dinged in metrics at work for deleting old project files. Thousands of lines that got counted as manual edits rather than ones made by AI.

    Open ##2690946