Given you propose to chose between 2 federated solutions, I assume you want a good robust federation. So it's easy: XMPP, period.

Anyone who has experienced self-hosting knows Matrix is several times heavier on memory and CPU than XMPP, and that's one of the reasons 99% of the Matrix users are on 1 server, while I actually dnn't even know which XMPP server is the largest.: