The AI will get crazy smart on harder difficulties. They will use spells, environment, and tactics in a much smarter way.

Dice throws are just the chance a weapon attack or saving throw succeeds or fails. So there is a difference.