198
The first GPT-4-class AI model anyone can download has arrived: Llama 405B (arstechnica.com)
submitted 2 years ago by to c/technology@lemmy.world
61 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 years ago (1 child)

Did anyone get 70b to run locally?

If so what, what hardware specs?

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 5 points 2 years ago (1 child)

    Afaik you need about 40GB of vram for a 70b model.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •