In better news, I've found that acetone, normal nail polish remover, takes the baked on ink off a bottle in a few swipes of a magic eraser.
Use this information as needed, people who need bottles for purposes (I stick most of mine upside down in terracota spikes to keep the garden watered)