Yes, it's very irritating lol. Basically, you know how sand is fairly abrasive by our standards? Well, sand has had millennia to get smoothed over by the natural cycles of our planet. As such, it's fairly smooth all things considered.
Lunar regolith has not had that same opportunity. It is extremely sharp - sharp enough to cut kevlar. There's a reason so much engineering goes into making EVA suits for lunar environments.