This is why I don't do podcasts in the background, I miss stuff and the whole thing becomes a confusing distraction.
What seems to work for me is something I have seen/heard a bunch of times in the background (Futurama, electronic music) which scratches that mind wandering itch without it dragging me away from what I want to be doing.