Same! I was told that I could not be a pilot because I wear glasses, so I gave up. In hindsight, it was probably OK. I've known several pilots and the first few years can be really hard to have a family or even a relationship.
Ironically, 3 of the pilots I know are afraid of heights.