Abacus.ai:

We recently released Smaug-72B-v0.1 which has taken first place on the Open LLM Leaderboard by HuggingFace. It is the first open-source model to have an average score more than 80.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 years ago

https://huggingface.co/senseable/Smaug-72B-v0.1-gguf/tree/main

About 44GB and 50GB for the Q4 and 5. You'd need quite some extra to fully use the 32k context length.

  • source
  • parent