'He will continue to damage the party': Ex-GOP lawmaker warns Republicans that Trump is a 'diminished figure'