What are you trying to do? Don't take this the wrong way, but I can't imagine anything i'd do on a server where i'd want a GUI.
Even where I could imagine it, there are other options. If you want a graphical file manager, run one in docker or use sshfs to mount it whenever you want. Change config files? Vim. Or nano or whatever if you hate vim. Or spin up a full coding environment whenever you need it and mount in your config files. Just don't leave it running and don't expose it. If you just need a linux desktop for a while, and it's not actually for your server, install a linuxserver.io webtop.
What are you trying to do?