Mice and some other pests have evolved an instinctual aversion to the smell of cats, it triggers their fear response. Just having the cats around might have been good enough.