Yeah it is completely unbelievable that the holodecks wouldn’t be primarily used to fuck virtual people.
Yes you can play Sherlock or play some ball in there but especially on a starship, between shore leaves, people would relieve themselves in there all the time, assuming the ship doesn’t have a perfect 100% ratio of sexually compatible personnel so everyone can get some.
Tenfold this for the voyager crew who are cooped up in a fixed and quite limited constellation of potential partners for years.