When I lose this job, honestly, I'm fucked and it will be a nightmare because I'll probably need to go into an office, and I'm in no shape for that.

Which is why you should be looking for another job that ticks all your checkboxes while you have this job.