'Not good signs for the Republican Party': GOP lawmakers have a problem with their own voters