No, it's a key stroke, not hand move. I don't have to reposition my hand to hit ESC. You do have to reposition your hand to use arrow keys.
Also, you usually move the cursor by more than just one character. It's one extra keystroke to reposition the cursor, not to move it by one char. You have shortcuts to jump to end of file, specific line, end of line or even create and jump to bookmarks. All this with just standard keys, without repositioning your hands to use the mouse or arrow keys.