Because the sun isn't a point source, they're still coming in from different directions depending on what part of the sun they originated from. The sun is far as hell but it's also big as hell.

Same principle as a pinhole camera kids make in science class.

Just a bunch of pinholes.

Basically a pinhole camera. The lens is doing the same thing as your eyeball. If your eye can see it, so can the lens.