You are taking a high five for WAAAAAAY more than what it is. I'm just high fiving people left and right, celebrating having a night out.
Nobody is trying to "win" you, or own you, or get one over on you. By the time I've high fived you, I've already high fived you......and then I'm high fiving the next person. Without further context, I'm not sure what you mean by you getting more attention than you want, or how that happens. I'm high fiving about 8 people in about 3 seconds, and then running to the next group. Within about 10 seconds the interaction is over, so I'm highly confused by what you're talking about.