Exactly! Rapidly changing accent for single words leads to poor understanding, which is the whole point of speech.
A loanword is not a word randomly spoken in another language, it's a word taken from one language into another, which often involves a change in pronunciation.
If you dont acknowledge that, you'd have to acknowledge that the entire French language is just poorly pronounced Latin, which is insane.
"Burrito" is a Spanish word for a little donkey, but it's also an English word for a food item, and they are not typically pronounced the same. Someone fluent in both languages will pronounce them differently depending on which language they are speaking.