Since pipewire is the default in Nobara (I recently started with it), I hope I don't need to care too much about it (fingers crossed!). What I want to achieve is a realistic feeling of the room accoustics in games. I recently noticed that in Cyberpunk 2077 (windows, with the xbox headset): I could close my eyes and still tell where I am in the game.

Exactly. You set up the virtual sink for 5.1 output and make pipewire convolute the signal with a suitable impulse response to turn it into a stereo signal that sounds like it's coming from the correct direction. And yes, most games will output surround sound, given the option.