364
Anthropic has developed an AI 'brain scanner' to understand how LLMs work and it turns out the reason why chatbots are terrible at simple math and hallucinate is weirder than you thought (www.pcgamer.com)
submitted 1 year ago by to c/technology@lemmy.world
165 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 17 points 1 year ago (1 child)

Unfortunately, these articles are often written by people who don't know enough to realize they're missing important nuances.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 9 points 1 year ago (1 child)

    It also doesn't help that the AI companies deliberately use language to make their models seem more human-like and cogent. Saying that the model e.g. "thinks" in "conceptual spaces" is misleading imo. It abuses our innate tendency to anthropomorphize, which I guess is very fitting for a company with that name.

    On this point I can highly recommend this open access and even language-wise accessible article: https://link.springer.com/article/10.1007/s10676-024-09775-5 (the authors also appear on an episode of the Better Offline podcast)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 1 year ago

    I can't contemplate whether LLMs think until someone tells me what it means to think. It's too easy to rely on understanding the meaning of that word only through its typical use with other words.

  • permalink
  • fedilink
  • source
  • parent