I promise it gets better! Improving your farming skill increases your energy efficiency while farming, that helps a lot. There are other ways to raise your energy as well. But yeah, I've been playing it for so long that I actually forgot that the first start was a little rough. So, thanks for the reminder. :)
I guess the one reason why SDV is filed as 'not stressful' in my head is because I know that it's impossible to permanently mess up in that game. Every little thing you do helps you, little by little.