Chesterton's fence is a warning not to commit this logical error: I don't know what this fence is for, therefore I know there is no reason for it.

It doesn't say never to remove it. It means you should try and figure out why it's there and ask around before removing it.