That's not universally true. I know several people with PhD who have encyclopedic knowledge completely outside their specialisation. Some people are just super intelligent, talented and have enormous memory. The world is not fair.