Reporters spar with press sec refusing to say if neurologist visited White House for Biden