overmetricing

This note last modified September 1, 2024

We value things that can be measured by metrics (test scores) vs subjective things (How well you work with others). This can create a perverse incentive to focus on improving the measurable things at the cost of everything else.

Dr. Thi Nguyen calls this phenomenon “value capture”

“The measurement of complex social phenomena is always reductionist” - Making Games In A Fucked Up World-Paolo Pedercini

technofetishism

Goodhart's law

Backlinks

  • value capture
    • We have rich and subtle values that we simplify into concrete, measurable values, which sucks

  • gamification can lead to overmetricing
    • gamification may cause a narrowing of focus and values, and thus overmetricing

  • conventional game design works against reflection
    • the temptation of clarity and overmetricing means that game designers try for scenarios with simple answers.
logo