There are actually a lot:
- Heaven is actually from the old english word for sky (Sky is from norse instead), so "Good Heavens" can be interpreted as non religious. In fact, Heaven singular is the afterlife place, heavens plural means the vast skies and stars, so i certainly see 'Good Heavens' as irreligious.
- Good Golly
- Fiddlesticks!