you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 2 days ago*

I see i can still order 96gb, for about 100k nok. That money would give me 2x dxg sparks - although with lower memory bandwidth - but 128gb each. And you don’t need ram for gui etc.

So 4 sparks can load deepseek r1 or v3 in nvfp4 and have have about 4kTops

For MoE this is acceptable, for dense it ism’t. Not sure how it fares on diffusion models.

They was kings when they had 256 and 512 versions but they stopped that this spring

  • source
  • parent