Because the sun isn't a point source, they're still coming in from different directions depending on what part of the sun they originated from. The sun is far as hell but it's also big as hell.