In my opinion the idea that we should only plant native plants and must eradicate invasives is comparable to ideas like allowing only white people and deporting brown people.
Plants, like people, have been migrating since ever, through different means of transport like long shoots extending the area of growth and seed dispersal by wind, water or animals. There is no point in history we could point to and say "This is the distribution of plant species over the planet that's desirable and we should strive to return to that." Just like there's no point in history where human people were distributed on the planet in a perfect way we should strive to go back to.
They're called invasive species for a reason. The issue isn't that they're not from here but that they often overtake the living space of native species and the effect on the ecosystem is going to be net-negative in the long run. Lupines are a good example as they're quite the nuisance around here. There are meadows here that otherwise would be filled with hundreds of different flowering native plants but once lupine takes over the entire field is going to be just that. That's not multiculturalism.