To use your analogy: intelligence is not the size of your muscles, it is the amount of muscle you can have. Just like intelligence the total amount of muscle your body can support is bounded maximally by your genetics. When you bulk up and become stronger you don't increase your quantity of muscle, you change the quality of it. Body building does not create new muscle cells, it rearranges them into stronger configurations.
Similarly learning and intelligence. Intelligence is not changed by learning, learning is your ability to exercise your intelligence. Learning is the strength to intelligence's muscle cell number.
Genetically very little has changed for humans since the Advent of organized religion, which was only 11000 years ago. There have been no major selective pressures and while humans are not in a steady state (obviously) they are still very slow to change.
Humans from 11k years ago would be most likely indistinguishable from the rest of us today genetically.