Pretty sure the conditions on the planet when oil/coal formed were substantially different from today. In particular, there are now various organisms which feed on the decaying matter that's at the start of that process. These organisms eat that matter and emit CO2 as they live and breathe, returning the carbon to the air instead of burying underground.