In newer versions of Lemmy you can quickly check someone's modlog:

That helps from time to time to see who you're dealing with