No need to scrub them most of the time. Technology Connections's tip of putting some detergent outside of the dispenser seems to help a little.
I have one thing that I've found needs to be scrubbed (a cup shaped thing that will have cake on egg), but almost everything else seems to get cleaned perfectly.