If you ask me it must be some sort of escapism. Owning and firing guns is an outlet, makes them think "I could totally overthrow this tyrannical government if I wanted to".
But of course a government that's had an armed population for hundreds of years knows how to deal with it and if anybody ever tried anything remotely resembling an insurrection they'd come down on them like a ton of bricks.