I think at the places where I've worked, torn jeans would be a little over the line in the office, although managers who said something about it would be perceived as stuffy. However, I would ask before wearing business casual to a meeting with clients. I would assume that a suit was expected and I think I would be in real trouble if I wore torn jeans.
But then again, I'm 35+ now. Do you work at a small startup?