▲ 194 ▼ The first minds to be controlled by generative AI will live inside video games (www.cnbc.com) submitted 2 years ago by Mazdak@lemmy.org to c/technology@lemmy.world 76 comments fedilink hide all child comments
[–] huginn@feddit.it 1 point 2 years ago (1 child) Sure thing: here's a white paper explicitly proving: No emergent properties (illusory due to bad measures) Predictable linear progress with model size https://arxiv.org/abs/2304.15004 permalink fedilink source parent hideshow 2 child comments replies: [–] MxM111@kbin.social 2 points 2 years ago* Thank you. This paper though does not state that there are no emergent abilities. It only states that one can introduce a metric with respect to which the emergent ability behaves smoothly and not threshold-like. While interesting, it only suggests that things like intelligence are smooth functions, but so what? Some other metrics show exponential or threshold dependence and whether the metric is right depends only how one will use it. And there is no law that emerging properties have to be threshold like. Quite the opposite - nearly all examples in physics that I know, the emergence appears gradually. permalink fedilink source parent
[–] MxM111@kbin.social 2 points 2 years ago* Thank you. This paper though does not state that there are no emergent abilities. It only states that one can introduce a metric with respect to which the emergent ability behaves smoothly and not threshold-like. While interesting, it only suggests that things like intelligence are smooth functions, but so what? Some other metrics show exponential or threshold dependence and whether the metric is right depends only how one will use it. And there is no law that emerging properties have to be threshold like. Quite the opposite - nearly all examples in physics that I know, the emergence appears gradually. permalink fedilink source parent