There are plenty of downsides to racism, but the biggest is perhaps the fear and paranoia it instills in those who have experienced it or seen it up close and personal.
It looks like the silver lining for celebrity abusers everywhere is that unless you use a racial slur while committing abuse you might be okay, career wise.