When you steal books from a library, you're preventing others from accessing those books. When you download a digital copy of a book, you aren't.

Same thing with money. If you stole my money, I'd be upset, but I wouldn't be upset if I had infinite money.