Instead of using xmodmap et al I have opted for using 'english international' as keyboard layout and relying on altgr layer to reach the swedish letters I need. Unless I am mistaken the french letters should be there as well. One big benefit of that is its available and works the same for both windows and linux