Even something as degoogled as DivestOS will override your permissions and sensor settings to make the dialer app work in all circumstances. So who knows what proprietary apps that many people need might exploit this possibility.

Like you say, unless you physically disconnect the hardware, you can never now.