Wanna name some examples? Because right now, it just sounds like a tankie bemoaning people not wanting the toxic waste that is your ideology flooding into their instances – through .ml but especially through the noxious cesspit of insufferable losers that is Hexbear.
Edit: And I'd add that defederation is barely a part of this. The main problem is simply that Lemmy doesn't have a lot of users, and so niche posts tend to receive minimal attention and effectively no discussion. I moderate a few niche-ish (but not that niche) communities on Lemmy.World (federated with .ml), and decent-enough posts I make there get effectively nothing.
While there are more significant causes, one such cause is that sane people don't want a social media where at every other step is a tankie shitting their pants about how North Korea is based as hell and how dare you impugn Kim Jong Un's name. I live with the tankies because I'd sooner quit social media than use Reddit again, but I never said I was sane. (Plenty also wouldn't like all the ancom shit, but I'm close-ish ideologically, and I at least recognize they're good people with good intentions and not just blatant, cowardly liars.)