you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago*

It's possible to run the big Deepseek model locally for around $15k, not $100k. People have done it with 2x M4 Ultras, or the equivalent.

Though I don't think it's a good use of money personally, because the requirements are dropping all the time. We're starting to see some very promising small models that use a fraction of those resources.

  • source
  • parent