The lore in 40k only exists to get people to buy little plastic soldiers. People read about their plastic soldiers in the lore and they want to go buy them.

GW can and will change lore in order to generate a profit.

And yes the 40k lore can be really interesting.