▲ 198 ▼ The first GPT-4-class AI model anyone can download has arrived: Llama 405B (arstechnica.com) submitted 2 years ago by Wilshire@lemmy.world to c/technology@lemmy.world 61 comments fedilink hide all child comments
[–] Deceptichum@quokk.au 13 points 2 years ago (2 children) Or you could run it via cpu and ram at a much slower rate. permalink fedilink source parent hideshow 4 child comments replies: [–] errer@lemmy.world 11 points 2 years ago (2 children) Yeah uh let me just put in my 512GB ram stick… permalink fedilink source parent hideshow 4 child comments replies: [–] Deceptichum@quokk.au 7 points 2 years ago Samsung do make them. Goodluck finding 512gb of VRAM. permalink fedilink source parent [–] bruhduh@lemmy.world 1 point 2 years ago https://www.ebay.com/p/116332559 lga2011 motherboards quite cheap, insert 2 xeon 2696v4 44 threads each totalling at 88 threads and 8 ddr4 32gb sticks, it comes quite cheap actually, you can also install Nvidia p40 with 24gb each, you can max out this build for ai for under 2000$ permalink fedilink source parent [–] chiisana@lemmy.chiisana.net 2 points 2 years ago Finally! My dumb dumb 1TB ram server (4x E5-4640 + 32x32GB DDR3 ECC) can shine. permalink fedilink source parent
[–] errer@lemmy.world 11 points 2 years ago (2 children) Yeah uh let me just put in my 512GB ram stick… permalink fedilink source parent hideshow 4 child comments replies: [–] Deceptichum@quokk.au 7 points 2 years ago Samsung do make them. Goodluck finding 512gb of VRAM. permalink fedilink source parent [–] bruhduh@lemmy.world 1 point 2 years ago https://www.ebay.com/p/116332559 lga2011 motherboards quite cheap, insert 2 xeon 2696v4 44 threads each totalling at 88 threads and 8 ddr4 32gb sticks, it comes quite cheap actually, you can also install Nvidia p40 with 24gb each, you can max out this build for ai for under 2000$ permalink fedilink source parent
[–] Deceptichum@quokk.au 7 points 2 years ago Samsung do make them. Goodluck finding 512gb of VRAM. permalink fedilink source parent
[–] bruhduh@lemmy.world 1 point 2 years ago https://www.ebay.com/p/116332559 lga2011 motherboards quite cheap, insert 2 xeon 2696v4 44 threads each totalling at 88 threads and 8 ddr4 32gb sticks, it comes quite cheap actually, you can also install Nvidia p40 with 24gb each, you can max out this build for ai for under 2000$ permalink fedilink source parent
[–] chiisana@lemmy.chiisana.net 2 points 2 years ago Finally! My dumb dumb 1TB ram server (4x E5-4640 + 32x32GB DDR3 ECC) can shine. permalink fedilink source parent