I guess I “know my birthday” by virtue of the fact that I hear the words “August 17th” (not my real birthday, but yeah) in my head when I casually wonder what my birthday is.

That would describe my experience. Aphantasia only affects the ability to visualise something, not the mental voice that I believe everybody has.