80 (quatre-vingt) comes from the base 20 system. That's a vestige from pre indo-European languages (specifically the Gauls) that ended up influencing France.
Interestingly (if I'm not mistaken), in Switzerland they actually say "huitante" and in Belgium they say "octante".