Yep, kinda similar setup here. I've got multiple types of headsets for various situations:

• A Plantronics headset for work (taking calls and meetings and stuff)
• A Beyerdynamic DT880, which is my main for listening to music at home
• A Sony WH-1000XM5, which I use in wired mode during travel, for it's noise cancellation features
• An Avantree E171, which I use during running and workouts

I don't really want to buy a dongle for everything, not to mention, you'd then run into the issue of not being able to charge your phone while using the dongle, unless you get a dongle that also allows charging and... it's just not a nice solution.