Honestly, that's pretty quick to learn that lesson. Huge corporations usually take way longer to figure that sort of thing out. Usually not until it's too late.
post
WTF even is an "AI PC"? I saw an ad for some AI laptop. To my knowledge, nobody is running LLMs on their personal hardware, so do these computers have like...a web browser?
To my knowledge, nobody is running LLMs on their personal hardware
They absolutely are.
Statistically relevant portion?
You know they were hyperbolic.
It’s two things:
- a machine that has NN-optimized segments on the CPU, or a discrete NPU
- microslop’s idiotic marketing and branding around trying to get everyone to use Copilot
You can run it on your laptop, I've tried it before (PS e.g. https://www.nomic.ai/gpt4all, it's fun to dig through your documents, but it wasn't as useful as I thought it would be in collecting ideas), what is truly hard is to train. But yeah, what is an AI PC? Is it like a gaming rig with lotsa RAM and GPU(s)?
Computers now come with a NPU (Neural Process Unit) to do that job... So yeah.
What kind of consumer-facing software runs on that NPU?
I know Video editing software uses it for things like motion tracking.
It's all stuff your GPU can do, but the NPU can do it for like 1/10th to 1/100th the power.
For what it’s worth an NPU is why your phone could tell you that photo is of a cat years before LLMs were the hot new thing. They were originally marketed as accelerators for machine learning applications before everybody started calling that AI.
New versions of Sony Vegas use the NPU to enhance AI features, nothing that humans cannot do before.
Lots of people are. Typically it means they have an NPU.
I'm talking about an ad I saw on broadcast television during a football game. I don't think the broad market of people are downloading models from huggingface or whatever.
Running an LLM locally is entirely possible with fairly decent modern hardware. You just won't be running the largest versions of the models. You're going to run ones intended for local use, almost certainly Quantized versions. Those usually are intended to cover 90% of use cases. Most people aren't really doing super complicated shit with these advanced models. They're asking it the same questions they typed into Google before, just using phrasing they used 20+ years ago with Ask Jeeves.
Not sure what the dell computers are doing but with something like Alpaca it’s pretty easy to run local LLMs
It is quite easy to run a distilled local model using a decent rig. I have one in that I use right from the terminal.
“We’re very focused on delivering upon the AI capabilities of a device—in fact everything that we’re announcing has an NPU in it — but what we’ve learned over the course of this year, especially from a consumer perspective, is they’re not buying based on AI,” admits Kevin Terwilliger, Dell’s head of product, in the PC Gamer interview. “In fact I think AI probably confuses them more than it helps them understand a specific outcome.”
They're just going to try to market it a little differently
Yes, it's useful for things like text to speech that doesn't sound like a Speak & Spell or motion detection that doesn't go off because a bug flew past the camera. I consider stuff like LLMs that will lie to me useless though.
Yeah I don't mind AI as another tool in the tool belt, but it's being forced as the magic one-size-fits-all solution. Also the AI tools must be opt-in by default.
Whoever is making the decisions at Dell just made a very wise one. I’d expect IBM to be the most pragmatic but maybe I missed the news about them
IBM got out of the retail desktop/laptop market in 2005 when they sold their product lines (like Thinkpad) to a company in China called Lenovo.
IBM has been all in on AI for like 20 years.
How long has Watson been out?
I care about AI PCs in that I actively do not want one. It's not that I'm indifferent.
I'm looking for an android smart watch and I'm annoyed at how many come with interactive AI, which I also do not want.
I don't necessarily hate AI, but I'll use it when I want to use it not when my system wants me to use it.
I like ai. For real. When I want to go there and use it. I open the browser, type to Gemini and use it. Hate it when it is all over everything, especially where you don't need an AI. Glad they got it
The last time my wife bought a Dell PC, she became an Apple customer. She wanted to avoid the Apple tax but ended up dealing with bloatware, crashes, a slow PC and their horrible customer service.
Its not that I don't care, its that they are too expensive & the monopolies want to exert control over the market. I considered buying a Ryzen AI Max+ 395. They actually had some okay deals for a bit, but they are still pretty inferior to GPU-accelerated solutions which are completely overpriced. Much of this was intentional, although RAM has recently seen more demand than supply. For a long time though, they were restricting the hardware & VRAM in GPUs though not because of price, but because it would take away from much of the dominance cloud-AI providers had, and also do so at the peril of them no longer being able to read & spy on your every conversation.
That is why IMO the US will lose the AI-race. Not because we don't have smart people, but because capitalism is anti-innovation.
well ig DELL is joining the corporation pack that dislikes
AI or criticize it:
IIRC: its Valve and Dreamworks that do it
and now its DELL with both
We don't care about dell anymore either. They have reduced the quality and standardization of their offerings to the point they are worse than just about any other 'brand'.
top 50 comments