Management has historically been interested in boiling down complex issues to so-called KPIs, so that employee performance can seemingly be presented in a simple dashboard. Are there such KPIs for AI?
2026-04-30 19:26 UTC
Replies (7)
-
@eestileib@lemmy.blahaj.zone 2026-04-30 19:44
The cost of tokens used as a percentage of your salary is the correct metric at NVidia and other firms. As far as I can tell, any activity performed with a chatbot is deemed to be a) productive and b) more productive than any conceivable activity not talking to a chatbot
-
@i_stole_ur_taco@lemmy.ca 2026-04-30 19:54
My company was using token burn as an AI adoption metric, but they’ve started clawing that back in search of better metrics. After a bunch of people all blew through $2000 of tokens over a weekend building “something”, leadership cooled their heels and is pivoting to trying to use AI more intelligently. And yet we can still measure productivity by how fast it takes to get a feature deployed and we can measure customer satisfaction… I still don’t understand why that’s insufficient. If adding AI made the line go up, then it is a benefit. If line not go up, why buy AI? Instead it seems like a lot of companies are just looking for new magic numbers to chase in order to justify their predetermined conclusions.
-
@slazer2au@lemmy.world 2026-04-30 19:35
each org will have its own KPI but from what I have seen from our customers many of them try to track how much employee time has been saved by handing work off to the "ai tooling"
-
@HobbitFoot@thelemmy.club 2026-04-30 21:44
Generally the only one I know of is for use. Technically, the KPI should be seeing increases in worker productivity, but a lot of jobs don't have meaningful KPI's.
-
@venusaur@lemmy.world 2026-05-01 08:29
At a high level I think it’s similar to integration of any other vendor. ROI calculation based on cost of vendor and value of costs reduced and/or revenue gained post integration. Companies may have some granular attribution models to say X investment in AI project was directly tied to Y outcomes valued at $Z. [Some execs are admitting that AI is costing more than humans.](https://www.mitsloanme.com/article/ai-compute-costs-exceed-workforce-costs-nvidia-executive-says/)
-
@CanIFishHere@lemmy.ca 2026-05-01 00:24
https://corporatefinanceinstitute.com/resources/data-science/ai-kpis-tracking-performance/ For Operations: Reduction in manual processing time – AI accelerates loan approval review, compliance checks, and reporting, freeing finance teams for higher-value analysis. Increase in automated transactions – AI-driven trading, payments, and credit risk models process thousands of transactions in seconds. Lower error rates – AI minimizes costly reporting errors, compliance mistakes, and financial miscalculations. These measurements are all over the internet.
-
@trxxruraxvr@lemmy.world 2026-04-30 19:43
If by historically you mean the last 80 years or so, you're using words wrong.