So-called “emergent” behavior in LLMs may not be the breakthrough that researchers think.

  • NounsAndWords@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    8 months ago

    Emergent behavior is pretty much anything an old model couldn’t do that a new model can. Simple reasoning, creating coherent sentences, “theory of mind”, basic math, translation, I think are a few examples.

    They aren’t “amazing” in the sense that a human can’t do them, but they are in the sense that a computer is doing it.

    • just another dev@lemmy.my-box.dev
      link
      fedilink
      English
      arrow-up
      5
      ·
      8 months ago

      They aren’t “amazing” in the sense that a human can’t do them, but they are in the sense that a computer is doing it.

      … without specifically being trained for it, to be precise.