196
Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard (huggingface.co)
submitted 2 years ago by to c/technology@lemmy.world
60 comments fedilink hide all child comments
 

Abacus.ai:

We recently released Smaug-72B-v0.1 which has taken first place on the Open LLM Leaderboard by HuggingFace. It is the first open-source model to have an average score more than 80.

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 2 years ago*

I tested it with a 16GB model and barely got 1 token per second. I don't want to imagine what it would take if I used 16GB of swap instead, let alone 130GB.

  • permalink
  • fedilink
  • source
  • parent