Apart from all the actual missed confrontations, it seems like you should just pay someone to be up on any building that's a security risk. They don't have to be super vigilant or highly trained, just the equivalent of a traffic cop working a construction site. Their presence alone would remove it as a threat.