▲ 196 ▼ Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard (huggingface.co) submitted 2 years ago by hexual@lemmy.world to c/technology@lemmy.world 60 comments fedilink hide all child comments Abacus.ai: We recently released Smaug-72B-v0.1 which has taken first place on the Open LLM Leaderboard by HuggingFace. It is the first open-source model to have an average score more than 80.
[–] OutrageousUmpire@lemmy.world 1 point 2 years ago (1 child) Any idea what 8Q requirements would be? Or 4 or 5? permalink fedilink source parent hideshow 2 child comments replies: [–] General_Effort@lemmy.world 2 points 2 years ago https://huggingface.co/senseable/Smaug-72B-v0.1-gguf/tree/main About 44GB and 50GB for the Q4 and 5. You'd need quite some extra to fully use the 32k context length. permalink fedilink source parent
[–] General_Effort@lemmy.world 2 points 2 years ago https://huggingface.co/senseable/Smaug-72B-v0.1-gguf/tree/main About 44GB and 50GB for the Q4 and 5. You'd need quite some extra to fully use the 32k context length. permalink fedilink source parent