you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 2 years ago (1 child)

local AI is cool and all, but neither the hardware nor the models are really ready for your average consumer

  • source
  • hideshow 2 child comments
  • [–] 2 points 2 years ago (1 child)

    Who actually uses "local AI" beyond developers and a handful of end users? These NPUs are wasted silicon - akin to sticking a gaming GPU in your CPU that only works for games that are either in development or 99% of people don't give a shit about

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 2 years ago

    The only real advantage of local AI is privacy and that it's much cheaper if you use it a lot.

    The only consumer use case I see in the wild with some real momentum behind it is role play.

    All the local AI communities I browse are 50% people trying to find usecases for it at their job (like me; unsuccessfully I might add) and 50% people interested in role play.

    People will apparently spend thousands to jerk off to a soulless machine demon simulacrum shell of a human.

    To be fair, I can see the appeal of local AI for video games, like RPGs. There is this really fun game called "Suck Up", where you are a vampire trying to convince AI to let you inside their house. That is the one real "killer" application I see atm.

    I personally see a lot of other useful usecases for local AI, but from my experience at work, I would estimste it will take another 5 years until any of it is anywhere near consumer ready.

  • source
  • parent