198
The first GPT-4-class AI model anyone can download has arrived: Llama 405B (arstechnica.com)
submitted 2 years ago by to c/technology@lemmy.world
61 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 14 points 2 years ago* (1 child)

It's available through ollama already. i am running the 8b model on my little server with it's 3070 as of right now.

It's really impressive for a 8b model

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    Intriguing. Is that an 8gb card? Might have to try this after all

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    Yup, 8GB card

    Its my old one from the gaming PC after switching to AMD.

    It now serves as my little AI hub and whisper server for home assistant

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    What the heck is whisper? Ive been fooling around with hass for ages, haven't heard of it even after at least two minutes of searching. Is it openai affiliated hardwae?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •