Not so, if you are OK using x11 you will probably have zero issues. Wayland support, however, is shit. I had a 1660 super when I switched and it was good. Just when I had two monitors with different refresh rates it get weird, x11 does not support it at all (there is some workarounds but they are workarounds). Wayland fix the issue but nvidia support for Wayland was veeery bad at the end of last year, when I switched to AMD.

The thing about being open source is just that the community could help move things faster and would not need to wait the good will of nvidia for everithing, but nvidia is still moving slow towards open source, it does not means that they aren't doing things and fixing bugs, just they are a bit slow and stubborn