I think an LLM integrated into the IDE would be better suited when it comes to projects that aren't backed by a company like Microsoft who have a large amount of GPU compute to spare for their users.

Or it'd be bart of a CI pipeline. AFAIK that is theoretically already possible. You could configure the existing CI to feed the code through some form of AI code check.