Yeah the door face is where the buttons and floor indicator are typically. Plus, other people might join the elevator before you get to your floor. Assuming you would rather be facing them then showing them your back it makes sense to turn around right away.
There are some social conformity experiments on youtube about getting people to face the "wrong" way though.