Sure you can make that argument under capitalism, where people are deprived of the value their labor created in order to force them to work more so they may survive. Hence why people should strive for communism. If everyone lived vegan people would be compelled to work as they are able in order to not cause undue burden on others, which again would not be vegan.
"From each according to their ability to each according to their need."