have all sorts of joke magic items that are really just used as improvised weapons.

Wait, yeah, wouldn't hitting a Poltergeist over the head with an algemy jug or even a potion bottle work? As a magic, improvised weapon?