GPUs aren't really suitable for many workloads. These CPUs are typically used in servers, you can't really offload a docker container onto a GPU.

This is the type of processor companies want in things like VM servers that host large numbers of VMs.

GPU processing units are really good at only specific kinds of computation. These are still all-around processors.

The alternative to multiple cores is a single core that runs faster. We tried this and hit a limit. So, it's many cores, now.

GPUs are still pretty bad at handling conditional logic and are more optimized towards doing mathematical operations instead.

But you are right in the sense that people are exploring different kinds of hardware for workloads that are getting increasingly specific. We're not in a CPU vs GPU world anymore, but more like a "what kind of CPU do I need?" situation.

One of their benchmark graphs is for Stable Diffusion, showing how much faster their CPU runs it than a 96 core AMD Epyc CPU. I'm like 99% sure that a GPU would run that at least 10 times faster.