▲ 198 ▼ The first GPT-4-class AI model anyone can download has arrived: Llama 405B (arstechnica.com) submitted 2 years ago by Wilshire@lemmy.world to c/technology@lemmy.world 61 comments fedilink hide all child comments
[–] bizarroland@fedia.io 1 point 2 years ago (1 child) It's clocked at ddr4 2666 permalink fedilink source parent hideshow 2 child comments replies: [–] BaroqueInMind@lemmy.one 2 points 2 years ago* With 144Gb of total RAM, you should be able to run any CPU intensive software. The LLMs use GPU vRAM though, so it doesn't matter how much system RAM you have, since GPU vRAM is what the xformers and tensor scripts prioritize and have been ultimately optimized to use over CPU and RAM. permalink fedilink source parent
[–] BaroqueInMind@lemmy.one 2 points 2 years ago* With 144Gb of total RAM, you should be able to run any CPU intensive software. The LLMs use GPU vRAM though, so it doesn't matter how much system RAM you have, since GPU vRAM is what the xformers and tensor scripts prioritize and have been ultimately optimized to use over CPU and RAM. permalink fedilink source parent