you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 years ago (1 child)

Are the cards really powerful enough for so much fuss?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 years ago*

    Definitely. An A100 system is around $10k which is expensive, but definitely in reach, and you need two of them to run a 70B parameter model. Possibly one if you are clever about it.

    And you can still do plenty of damage with a $1000 consumer grade GPU. Most deepfake videos are trained on these platforms.

  • source
  • parent