ChatGPT is dismissing it, but I’m not so sure.

  • 𝕽𝖚𝖆𝖎𝖉𝖍𝖗𝖎𝖌𝖍@midwest.social
    link
    fedilink
    English
    arrow-up
    73
    arrow-down
    4
    ·
    5 hours ago

    Seriously, do not use LLMs as a source of authority. They are stochistic machines predicting the next character they type; if what they say is true, it’s pure chance.

    Use them to draft outlines. Use them to summarize meeting notes (and review the summaries). But do not trust them to give you reliable information. You may as well go to a party, find the person who’s taken the most acid, and ask them for an answer.

    • dream_weasel@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      9 minutes ago

      First sentence of each paragraph: correct.

      Basically all the rest is bunk besides the fact that you can’t count on always getting reliable information. Right answers (especially for something that is technical but non-verifiable), wrong reasons.

      There are “stochastic language models” I suppose (e.g., click the middle suggestion from your phone after typing the first word to create a message), but something like chatgpt or perplexity or deepseek are not that, beyond using tokenization / word2vect-like setups to make human readable text. These are a lot more like “don’t trust everything you read on Wikipedia” than a randomized acid drop response.

      • BaroqueInMind@lemmy.one
        link
        fedilink
        English
        arrow-up
        12
        arrow-down
        18
        ·
        edit-2
        4 hours ago

        So then, if you knew this, why did you bother to ask it first? I’m kinda annoyed and jealous of your AI friend over there. Are you breaking up with me?

          • WarlockoftheWoods@lemy.lol
            link
            fedilink
            English
            arrow-up
            23
            arrow-down
            6
            ·
            3 hours ago

            Dude, people here are such fucking cunts, you didn’t do anything wrong, ignore these 2 trogledytes who think they are semi intelligent. I’ve worked in IT nearly my whole life. I’d return it if you can.

          • Empricorn@feddit.nl
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            17
            ·
            3 hours ago

            Defensive… If someone asks you for advice, and says they have doubts about the answer they received from a Magic 8-Ball, how would you feel?

        • traches@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          5
          ·
          3 hours ago

          Because it’s like a search box you can explain a problem to and get a bunch of words related to it without having to wade through blogspam, 10 year old Reddit posts, and snippy stackoverflow replies. You don’t have to post on discord and wait a day or two hoping someone will maybe come and help. Sure it is frequently wrong, but it’s often a good first step.

          And no I’m not an AI bro at all, I frequently have coworkers dump AI slop in my inbox and ask me to take it seriously and I fucking hate it.

          • richmondez@lemdro.id
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            2
            ·
            2 hours ago

            But once you have it’s output, unless you already know enough to judge if it’s correct or not you have to fall back to doing all those things you used the AI to avoid in order to verify what it told you.

            • traches@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              1 hour ago

              Sure, but you at least have something to work with rather than whatever you know off the top of your head

    • roofuskit@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      3
      ·
      3 hours ago

      Just a reminder that LLMS can only truncate text, they are incapable of summarization.