I would be ok with it. My wife is on the fence. We do frequent BDSM parties which she is really in to. Still, I'm the only one who does a scene with her. There's typically no sex going on at those places.
We've entertained the idea of going to some swingers clubs and testing the water. Hasn't happened yet but the last few months life has gotten in the way. We may start looking again.