More and more white voters are abandoning Trump — and race relations appear be the ‘driving factor’