Well it's the training of LLMs that consumes so much energy, simply using them (for say software development purposes) (inference) probably takes less power than recompiling your Gentoo.