657
Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie (www.nytimes.com)
submitted 2 years ago by [M] to c/techtakes@awful.systems
252 comments fedilink hide all child comments
 

archive https://archive.ph/is57b

you are viewing a single comment's thread
view the rest of the comments
[–] 11 points 2 years ago* (last edited 2 years ago) (1 child)

It doesn’t read on demand

Yes, it does, from the information it was trained on (or - stored), which like you say, requires a lot of hardware power so it can be accessed on demand. It isn't just manifesting the information out of thin air, and it definitely doesn't "remember" in the same way we do (E: even the best photographic memory isn't the same as an indexable one).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 6 points 2 years ago (2 children)

    It's definitely not indexed, we use RAG architectures to add indexing to data stores that we want the model to have direct access to, the relevant information is injected directly in the context (prompt). This can somewhat be equated to short term memory

    The rest of the information is approximated in the weights of the neural network which gives the model general knowledge and intuition..akin to long term memory

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 14 points 2 years ago

    or it can be equated to a shitty database and lossy compression (with artifacts in the form of “hallucinations”), but that doesn’t make the tech sound particularly smart, does it?

    but half the posts in your history are in this thread and that’s too many already

  • permalink
  • fedilink
  • source
  • parent
  • [–] -4 points 2 years ago (1 child)

    People have such crazy misconceptions about AI. Glad to see someone else knows how it works at least.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •