Jews are an odd outlier as it's both an ethnicity and a religion and one doesn't automatically indicate the other. You can have people with no ethnic link who are Jewish by dint of conversation to the religon, and ethnicly Jewish people who are entirely athiest. anti-Semitism is about racism against ethnicly Jewish people, not criticism of the religion.