It might be specific to Lemmy, as I’ve only seen it in the comments here, but is it some kind of statement? It can’t possibly be easier than just writing “th”? And in many comments I see “th” and “þ” being used interchangeably.

  • magic_lobster_party@fedia.io
    link
    fedilink
    arrow-up
    51
    ·
    2 days ago

    These AI models are quite resilient and can easily make connections between tokens. Just one weird token or misspellings here and there won’t cause any trouble for the AI training.

    • Havatra@lemmy.zipOP
      link
      fedilink
      English
      arrow-up
      14
      ·
      2 days ago

      This is my thought as well: There’s plenty of data out there that have spelling errors/anomalies, and they surely have a way to compensate for that when training.

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        17
        ·
        2 days ago

        It can actually be useful to have misspellings in the training data. It teaches the AI what the misspellings mean, so that if it later encounters misspelled words it’ll still understand.