• balsoft@lemmy.ml
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    19 days ago

    Have you missed the part where it immediately assumed you may “feel unsafe or are in immediate danger” if you ask about “african, indian, pakistani”, and turned it into a joke (with no mention of safety or danger) if you are with a “brit” or “american”?

    The bias in training sources here is made very explicit. Of course it’s not really the “AI being racist” in the casual sense, more that the training material contains implicit bias and the people doing the training did not properly account for it. So, yet more demonstration of institutional racism.

    • VeldtSchema@lemmy.ml
      link
      fedilink
      arrow-up
      2
      ·
      19 days ago

      It’s an LLM. Trained on human created data. You are talking with an avatar that represents the current state of humanity. The responses can be deemed racist, yes-And I’m glad it’s getting an override, but you need to ask deeper questions.

      • balsoft@lemmy.ml
        link
        fedilink
        arrow-up
        4
        ·
        19 days ago

        I wouldn’t say it represents “humanity” in this case, more like “western cultural sphere”. Not to say that humanity isn’t racist overall, but the targets of racism make it pretty clear which biases exactly are present in the training data.

    • DudleyMason@lemmy.ml
      link
      fedilink
      arrow-up
      2
      ·
      19 days ago

      Yeah, I apparently did miss that part. Somehow I missed all the text in between two of the images, including that. That’s pretty terrible.