How do you choose who the unlucky bastards are that get sent to the field to grow food for the people who don’t have to work?

Preferably, they'd be people without disabilities that prevent them from doing that kind of work. OP didn't say, "Nobody should work," just that being able to live shouldn't be dependent on working.

For millions of people with disabilities, the difference between those two ideas is life-changing. It's important not to conflate them.