People wear their glasses everywhere, including a variety of places where there is an expectation of privacy or where it is otherwise prohibited to record. Places where you would not be allowed to hold up your phone or camera and take photos.

The introduction of tech that makes it impossible to distinguish between someone minding their own business and someone recording you demands a change to the legal framework. It doesn't make sense to hold to laws that were written for an entirely different scenario.

I don’t see people assaulting CCTV cameras for instance

I've seen that fairly often, particularly around political protests, and I've never seen a CCTV camera in a public bathroom, locker room, etc.

This tech is an inevitability and the potential legitimate uses are too valuable to ban it outright. But that doesn't mean it should be treated exactly like a highly-visible camera or cell phone.