If you're running enough images on the same machine to make that a relevant point, you have absolutely no excuse not to provide common base images.

Basically, there are two scenarios here: you're running some service for others to deploy their images (Azure etc), then you want isolation. Or you're running your own images, then you should absolutely provide a common base image.