The problem is that the "train of the thought" is also hallucinations. It might make the model better with more compute but it's diminishing rewards.

Rpg can use the llms because they're not critical. If the llm spews out nonsense you don't like, you just ask to redo, because it's all subjective.