New York City is located in the southeastern corner of the state, so "upstate NY" means basically everything north/west of the NYC metro area. It's a word that is pretty much exclusively used for New York.