1120
Microsoft Needs So Much Power to Train AI That It's Considering Small Nuclear Reactors (futurism.com)
submitted 2 years ago by to c/technology@lemmy.world
381 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 19 points 2 years ago* (1 child)

You say "simply train," but really, the training of these models is The most intensive part. Once they are trained, they require less power (relatively) to actually run for inference.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    So it sounds like they need a shitload of GPU power. You know what also costs a shitload of GPU power crypto mining? Could they not outsource the work to all those GPUs that stopped mining crypto once it plummeted?

    I am surprised this hasn't become a community project already. I assume there is some limitation that I am unaware of.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 2 years ago (1 child)

    The limitation is intellectual property. You need to model to train it, and no for-profit company is going to just give that away.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    But they (MS) are planning on doing it either way, why not crowdsource and even pay a small pittance for the GPU power? I think it would be popular... there are a lot of sad people with extra GPUs sitting around not being used for much.

  • permalink
  • fedilink
  • source
  • parent