in this scenario it wouldn't be speed, though, it would be speed over time. Speed is velocity.

Watts are just joules but arbitrarily defined. Joules are a unit of total energy. A collective amount of work potential. Watts are an in situ measurement of those joules doing work.

If we want to talk about confusing units, W and VA are the units to be talking about.