▲ 441 ▼ Amazon Shuts Down Internal AI Leaderboard After Employees Cheated (www.404media.co) submitted 2 months ago by themachinestops@lemmy.dbzer0.com to c/technology@lemmy.world 91 comments fedilink hide all child comments Amazon has shut down an internal company leaderboard which ranked employees based on how much they used AI tools at work.
[–] luciferofastora@feddit.org 126 points 2 months ago (3 children) If a metric becomes a target... How many times do we have to teach you the same lesson, old man? permalink fedilink source hideshow 6 child comments replies: [–] bradbeattie@lemmy.ca 17 points 2 months ago (2 children) https://lawsofsoftwareengineering.com/laws/goodharts-law/ https://hacker-laws.com/#goodharts-law permalink fedilink source parent hideshow 4 child comments replies: [–] Sinthesis@lemmy.today 3 points 2 months ago* ctrl + f + goodhart There it is 👍 permalink fedilink source parent [–] luciferofastora@feddit.org 1 point 2 months ago I should probably spell it out, yeah. It's my favourite counterbalance to certain managers at my company regurgitating a half-understood "If you can't measure it, you can't manage it" (which is also almost entirely bullshit, but MBAs need a one-size-fits-all solution in order for the whole premise of their degree to work, so they attempt to make businesses conform to their methods instead of adapting their methods to the business). You can't use a single measure (or only directly dependent measures), then tell people to improve that measure without figuring out just why it's lagging and working on that instead. permalink fedilink source parent [–] Colonel_Panic_@eviltoast.org 15 points 2 months ago (1 child) If a metric becomes a target, It ceases to be a good measure. If it ceases to be a good measure, It will want a glass of milk. If it wants a glass of milk, It will want a cookie. If it wants a cookie, It will need to become a target. If it needs to become a target, It will want to be a measure. permalink fedilink source parent hideshow 2 child comments replies: [–] Knoxvomica@lemmy.ca 1 point 2 months ago Hey I know that book! permalink fedilink source parent [–] some_guy@lemmy.sdf.org 11 points 2 months ago At least once more. permalink fedilink source parent
[–] bradbeattie@lemmy.ca 17 points 2 months ago (2 children) https://lawsofsoftwareengineering.com/laws/goodharts-law/ https://hacker-laws.com/#goodharts-law permalink fedilink source parent hideshow 4 child comments replies: [–] Sinthesis@lemmy.today 3 points 2 months ago* ctrl + f + goodhart There it is 👍 permalink fedilink source parent [–] luciferofastora@feddit.org 1 point 2 months ago I should probably spell it out, yeah. It's my favourite counterbalance to certain managers at my company regurgitating a half-understood "If you can't measure it, you can't manage it" (which is also almost entirely bullshit, but MBAs need a one-size-fits-all solution in order for the whole premise of their degree to work, so they attempt to make businesses conform to their methods instead of adapting their methods to the business). You can't use a single measure (or only directly dependent measures), then tell people to improve that measure without figuring out just why it's lagging and working on that instead. permalink fedilink source parent
[–] Sinthesis@lemmy.today 3 points 2 months ago* ctrl + f + goodhart There it is 👍 permalink fedilink source parent
[–] luciferofastora@feddit.org 1 point 2 months ago I should probably spell it out, yeah. It's my favourite counterbalance to certain managers at my company regurgitating a half-understood "If you can't measure it, you can't manage it" (which is also almost entirely bullshit, but MBAs need a one-size-fits-all solution in order for the whole premise of their degree to work, so they attempt to make businesses conform to their methods instead of adapting their methods to the business). You can't use a single measure (or only directly dependent measures), then tell people to improve that measure without figuring out just why it's lagging and working on that instead. permalink fedilink source parent
[–] Colonel_Panic_@eviltoast.org 15 points 2 months ago (1 child) If a metric becomes a target, It ceases to be a good measure. If it ceases to be a good measure, It will want a glass of milk. If it wants a glass of milk, It will want a cookie. If it wants a cookie, It will need to become a target. If it needs to become a target, It will want to be a measure. permalink fedilink source parent hideshow 2 child comments replies: [–] Knoxvomica@lemmy.ca 1 point 2 months ago Hey I know that book! permalink fedilink source parent
[–] some_guy@lemmy.sdf.org 11 points 2 months ago At least once more. permalink fedilink source parent