I'm allergic to cats but grew up with one (she lived to 21!) and my fiance has a cat and we moved in together. It's fine I just have to keep the cat away from my face and I wash my hands after petting her.

Even if I don't I just get really itchy, it's not the worst. Worth it for the pets and cuddles.