Just did some troubleshooting. I had 550 for a bit, upgrading to 580 did nothing. I seem to have fixed my issues by changing Ubuntu's display framerate from 30 to 60