• morrowind@lemmy.ml
    link
    fedilink
    arrow-up
    1
    ·
    17 hours ago

    I’m well aware, but you don’t need to necessarily see each character to translate to bytes

    • GissaMittJobb@lemmy.ml
      link
      fedilink
      arrow-up
      1
      ·
      16 hours ago

      It’s not out of the question that we get emergent behaviour where the model can connect non-optimally mapped tokens and still translate them correctly, yeah.

      • kautau@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        32 minutes ago

        I’m confused, is the concern when the model doesn’t properly identify when it is using software to identify something like a hex pattern?