'The time is now': Trump critics call out 4 ex-presidents for their silence