I should have clarified - the configure script is only for stuff built in to the C source code. It won't get rid of the games and whatnot, but remove support for things like sound, graphics formats, bignums, etc.
I suppose you could try deleting stuff out of /usr/share/emacs, but I wouldn't recommend it.