Rust is only huge because it doesn't have an ABI. If you had an ABI (and didn't have to compile every single dependency into the binary) the binary sizes would probably drop a lot to the point where they're only slightly bigger than a C counterpart

Edit: I don't know if Go has an ABI but they also include a runtime garbage collector in their binaries so that probably has something to do with it.