People do ACTUALLY say I'd of in lots of regions of the US. That's how you actually say the phrase. Welcome to English. If you think you know the rules some random group of 1000s of people will prove you wrong because they havent given a single fuck about what's proper for a hundred years or so. Basically every physical possiable way to say the phrase is in use somewhere.