A fair question. And something that I have given thought to. It'll depend on what is turned up. Downvoting a comment on its own is not against the rules. So, potentially nothing.

Stalking a user across multiple communities, downvoting all their comments while otherwise not being engaged at all in those communities takes us into bullying territory. Reddit had a built-in defense against that activity. If you go to a user profile there and just downvote all the comments, they don't actually take effect against the target. Lemmy doesn't have that feature yet. From that point, we'll see. I honestly don't know if it's even possible to do more than just see the vote records. If I delete a downvote, Lemmy may simply restore it through the next federation sync.

Whatever it is, I'll be transparent about it. I'm also conscious of the precedent this might set. Neither Lodion nor I are much interested in poking through the database and manually touching anything lightly.