Republicans get raked over the coals for leaving town as fiscal cliff looms: 'Going to lead to desperation for millions'