▲ 62 ▼ Microsoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism (arstechnica.com) submitted 2 years ago by Alphane_Moon@lemmy.world to c/technology@lemmy.world 10 comments fedilink hide all child comments
[–] Zrybew@lemmy.world 1 point 2 years ago (2 children) Yeah... Why does it sound dumb in so many level? permalink fedilink source parent hideshow 4 child comments replies: [–] Voroxpete@sh.itjust.works 4 points 2 years ago (1 child) Because he's a salesman, and he's selling you bullshit. What the experts are now saying is that it looks like the LLM approach to AI will require exponentially larger amounts of training data (and data processing) to achieve linear growth. Next generation AI models will cost ten times as much to train, and the generation after that will cost ten times as much again. The whole thing is a giant con. Kevin is just trying to keep investor confidence floating for a little longer. permalink fedilink source parent hideshow 2 child comments replies: [–] sugar_in_your_tea@sh.itjust.works 1 point 2 years ago And the harder the sell, the worse the product. permalink fedilink source parent [–] conciselyverbose@sh.itjust.works 1 point 2 years ago lol I honestly needed to open the article to parse the title. That's why I posted. But I'm definitely of the belief that you need a hell of a lot more architecture than they have to go meaningfully further. Humans are a hell of a lot more complicated than a bit like of neurons. permalink fedilink source parent
[–] Voroxpete@sh.itjust.works 4 points 2 years ago (1 child) Because he's a salesman, and he's selling you bullshit. What the experts are now saying is that it looks like the LLM approach to AI will require exponentially larger amounts of training data (and data processing) to achieve linear growth. Next generation AI models will cost ten times as much to train, and the generation after that will cost ten times as much again. The whole thing is a giant con. Kevin is just trying to keep investor confidence floating for a little longer. permalink fedilink source parent hideshow 2 child comments replies: [–] sugar_in_your_tea@sh.itjust.works 1 point 2 years ago And the harder the sell, the worse the product. permalink fedilink source parent
[–] sugar_in_your_tea@sh.itjust.works 1 point 2 years ago And the harder the sell, the worse the product. permalink fedilink source parent
[–] conciselyverbose@sh.itjust.works 1 point 2 years ago lol I honestly needed to open the article to parse the title. That's why I posted. But I'm definitely of the belief that you need a hell of a lot more architecture than they have to go meaningfully further. Humans are a hell of a lot more complicated than a bit like of neurons. permalink fedilink source parent