IIRC its the reverse as the name of the fruit goes back to Sanskrit naranga-s.

Fruit first, color name later - as in "the color of an orange", which then became just "orange".