It's also the preferred descriptor for some. I've had friends with dwarfism that thought "little people" was condescending as hell and hated it.
None of this is ever black and white. Especially when it's just interjecting into comments on the Internet talking about the fantasy race that's either Jews with battle axes or persons from Svartálfheim.