843
It must be a silent R (lemmy.world)
submitted 2 years ago by to c/programmer_humor@programming.dev
123 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 2 years ago (2 children)

Eh

If I program something to always reply “2” when you ask it “how many [thing] in [thing]?” It’s not really good at counting. Could it be good? Sure. But that’s not what it was designed to do.

Similarly, LLMs were not designed to count things. So it’s unsurprising when they get such an answer wrong.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    I can evaluate this because it's easy for me to count. But how can I evaluate something else, how can I know whether the LLM ist good at it or not?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago

    Assume it is not. If you’re asking an LLM for information you don’t understand, you’re going to have a bad time. It’s not a learning tool, and using it as such is a terrible idea.

    If you want to use it for search, don’t just take it at face value. Click into its sources, and verify the information.

  • permalink
  • fedilink
  • source
  • parent