That may be true due to the backlash from people on his political spectrum.