I am a native speaker, and I do take my word choices very seriously - often to the point of pausing during conversations to find the exact phrasing which will convey the shade of meaning I am looking to convey. I wrote fiction for a while, and it was always extremely important to me to get phrasing right.
I agree with you completely. While I would interpret all of those phrases as equivalent (based on context) if they were to come from someone else, I would tend to use them in exactly the ways you suggest.