I feel you man, I know people that grew up in environments like that, and if you are not temperamentally suited for them they will chew you up.

I found it got a lot better when I moved out on my own and could choose who I spent time and who I did not. But not everyone can do that when they need the most.