In my view, and others will disagree with me, you are either a male or a female. Your inner voice may sometimes be female. In Jungian terms you could consider it the anima. It doesn't mean you're actually female, but that there are inner female traits.
I've sometimes identified my inner voice as having female traits, but primarily it is male, and when i hear a female voice, usually it is a spirit talking to me.