I wonder if your brain then starts to align how you hear your own voice and how you hear it when it's recorded. If it starts to sound more the same for you. Would also be really weird if you for a long period only heard recordings of you speaking, and when you start speak again, you get equally, or probably more, freaked out by your own voice, as when your hear it recorded.