1120
Microsoft Needs So Much Power to Train AI That It's Considering Small Nuclear Reactors (futurism.com)
submitted 2 years ago by to c/technology@lemmy.world
381 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago (1 child)

I can't imagine they are. What would the training data of those models be? Why would you train the model when the user sent a request? Why would you wait responding to the request until the model is trained?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    Often, these models are a feedback loop. The input from one search query is itself training data that affects the result of the next query.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    Sure, but that's not done with the kind of model this thread is about (separate training and inference). You're talking about classical ML models with continuous updates, which you wouldn't run on this kind of GPU infrastructure.

  • permalink
  • fedilink
  • source
  • parent