• Bane_Killgrind@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    14 days ago

    The problems don’t come from explicit racist language or something overt like that. It can be as simple as a trained model settling into correlations that we don’t expect, and reinforcing biases in that way.

    Like you give it positively scoring prior hires, who all happen to be in men’s sports leagues during college. The model picks that up and scores new resumes with men’s leagues participation higher.

    • NoiseColor @lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      14 days ago

      That’s true, but that’s the bias the article talks about. Anyway, they should really do a pvp on this.